Jul 09 09:09:08 devstack cinder-volume[76003]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:09:08 devstack cinder-volume[76003]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:09:08 devstack cinder-volume[76003]: we strongly recommend against using it for new projects. Jul 09 09:09:08 devstack cinder-volume[76003]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:09:08 devstack cinder-volume[76003]: framework. For more detail see Jul 09 09:09:08 devstack cinder-volume[76003]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:09:08 devstack cinder-volume[76003]: import eventlet # noqa Jul 09 09:09:10 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:09:10 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:09:10 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:09:11 devstack cinder-volume[76003]: INFO dbcounter [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Registered counter for database cinder Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG oslo_db.sqlalchemy.engines [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG dbcounter [-] [76003] Writer thread running {{(pid=76003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:09:11 devstack cinder-volume[76003]: INFO cinder.rpc [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:09:11 devstack cinder-volume[76003]: INFO cinder.rpc [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG oslo_db.sqlalchemy.engines [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:09:11 devstack cinder-volume[76003]: INFO cinder.volume.manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Determined volume DB was empty at startup. Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG cinder.volume.manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76003) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:09:11 devstack cinder-volume[76003]: INFO cinder.volume.manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 09:09:11 devstack cinder-volume[76003]: WARNING stevedore.named [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:09:11 devstack cinder-volume[76003]: WARNING castellan.key_manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:09:11 devstack cinder-volume[76003]: WARNING cinder.keymgr.conf_key_mgr [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG cinder.volume.drivers.lvm [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76003) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 09:09:11 devstack cinder-volume[76003]: DEBUG oslo_concurrency.processutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76003) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_concurrency.processutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] CMD "cinder-rtstool verify" returned: 0 in 0.520s {{(pid=76003) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_db.sqlalchemy.engines [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:09:12 devstack cinder-volume[76003]: INFO cinder.rpc [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 09:09:12 devstack cinder-volume[76003]: INFO cinder.rpc [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 09:09:12 devstack cinder-volume[76003]: WARNING stevedore.named [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:09:12 devstack cinder-volume[76003]: WARNING castellan.key_manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:09:12 devstack cinder-volume[76003]: INFO cinder.volume.manager [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_db.sqlalchemy.engines [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:09:12 devstack cinder-volume[76003]: INFO oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Starting 1 workers Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Started child 76172 {{(pid=76003) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Full set of CONF: {{(pid=76003) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] ******************************************************************************** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Configuration options gathered from: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] ================================================================================ {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] allow_availability_zone_fallback = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] allow_compression_on_image_upload = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] allowed_direct_url_schemes = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] api_rate_limit = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] auth_strategy = keystone {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] az_cache_duration = 3600 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_availability_zone = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_host = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_stats_polling_interval = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backup_api_class = cinder.backup.api.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backup_name_template = backup-%s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backup_use_same_host = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backup_use_temp_snapshot = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] chap_password = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] chap_username = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_internal_tenant_project_id = 83a6d612873349fdb72ac5cfacb6be25 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_internal_tenant_user_id = bb5b30f3775242d7b365d6cd039b675a {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cloned_volume_same_az = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cluster = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] compression_format = gzip {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] compute_api_class = cinder.compute.nova.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76172]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] config_dir = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] config_source = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] control_exchange = openstack {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] debug = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] default_availability_zone = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] default_group_type = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] default_volume_type = lvmdriver-1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] disk_geometry = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_client_cert = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_client_cert_key = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_data_namespace = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_ssl_cert_path = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_ssl_cert_verify = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] driver_use_ssl = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] enable_force_upload = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] enable_new_services = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] enable_unsupported_driver = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] enforce_multipath_for_image_xfer = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] filter_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_api_insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_api_servers = ['http://192.168.122.86/image'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_api_ssl_compression = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_ca_certificates_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_catalog_info = image:glance:publicURL {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_num_retries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance_request_timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] goodness_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] graceful_shutdown_timeout = 5 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] group_api_class = cinder.group.api.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] host = devstack {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_compress_on_upload = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_conversion_address_space_limit = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_conversion_cpu_limit = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_conversion_disable = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_upload_use_cinder_backend = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_upload_use_internal_tenant = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_volume_cache_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_volume_cache_max_count = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] image_volume_cache_max_size_gb = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] init_host_max_objects_retrieval = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] instance_format = [instance: %(uuid)s] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iscsi_target_flags = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iscsi_write_cache = on {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iser_helper = tgtadm {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iser_ip_address = 192.168.122.86 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iser_port = 3260 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_color = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_config_append = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_dir = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_options = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_rotate_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_rotate_interval_type = days {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] log_rotation_type = none {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] max_age = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] max_logfile_count = 30 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] max_logfile_size_mb = 200 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] max_over_subscription_ratio = 20.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] message_reap_interval = 86400 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] message_ttl = 2592000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] migration_create_volume_timeout_secs = 300 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] monkey_patch = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] monkey_patch_modules = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] my_ip = 192.168.122.86 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] no_snapshot_gb_quota = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] num_iser_scan_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] num_shell_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] num_volume_device_scan_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] nvmeof_conn_info_version = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] nvmet_ns_id = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] nvmet_port_id = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_max_limit = 1000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_ext_list = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_listen_port = 8776 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_use_ssl = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] osapi_volume_workers = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] per_volume_size_limit = -1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] periodic_fuzzy_delay = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] periodic_interval = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] public_endpoint = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] publish_errors = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_backup_gigabytes = 1000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_backups = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_gigabytes = 1000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_groups = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_snapshots = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] quota_volumes = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] rate_limit_burst = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] rate_limit_except_level = CRITICAL {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] rate_limit_interval = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] reinit_driver_count = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] replication_device = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] report_discard_supported = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] report_interval = 120 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] reservation_clean_interval = 86400 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] reservation_expire = 86400 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] reserved_image_namespaces = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] reserved_percentage = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] rpc_response_timeout = 120 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] run_external_periodic_tasks = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] scst_target_driver = iscsi {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] scst_target_iqn_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_down_time = 720 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] shell_completion = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] snapshot_name_template = snapshot-%s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] snapshot_same_host = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] split_loggers = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] state_path = /opt/stack/data/cinder {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] storage_availability_zone = nova {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] storage_protocol = iSCSI {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] syslog_log_facility = LOG_USER {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_helper = lioadm {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_ip_address = 192.168.122.86 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_port = 3260 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_protocol = iscsi {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] target_secondary_ip_addresses = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] trace_flags = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] transport_url = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] until_refresh = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_chap_auth = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_default_quota_class = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_journal = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_json = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_multipath_for_image_xfer = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_stderr = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] use_syslog = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] verify_glance_signatures = enabled {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_api_class = cinder.volume.api.API {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_backend_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_clear = zero {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_clear_ionice = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_clear_size = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_copy_bps_limit = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_dd_blocksize = 1M {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_name_template = volume-%s {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_service_inithost_offload = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volume_usage_audit_period = month {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] zoning_mode = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_concurrency.disable_process_locking = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.auth_section = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.auth_type = password {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.auth_version = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.cache = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.include_service_catalog = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.interface = public {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_password = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcache_username = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.region_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.service_type = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.86/identity {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.backend = dogpile.cache.null {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.backend_argument = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.backend_expiration_time = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.config_prefix = cache.oslo {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.debug_cache_backend = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.enable_retry_client = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.enable_socket_keepalive = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.expiration_time = 600 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.hashclient_retry_attempts = 2 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_dead_retry = 300 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_pool_maxsize = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_sasl_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.password = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.proxies = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.redis_db = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.redis_server = localhost:6379 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.retry_attempts = 2 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.retry_delay = 0.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.socket_keepalive_count = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.socket_keepalive_idle = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.socket_keepalive_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.socket_timeout = 1.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.tls_allowed_ciphers = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.tls_cafile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.tls_certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.tls_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.tls_keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cache.username = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] coordination.backend_url = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.asyncio_connection = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.asyncio_slave_connection = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.backend = sqlalchemy {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.connection = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.connection_debug = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.connection_parameters = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.connection_recycle_time = 3600 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.connection_trace = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.db_inc_retry_interval = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.db_max_retries = 20 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.db_max_retry_interval = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.db_retry_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.max_overflow = 50 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.max_pool_size = 5 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.max_retries = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.mysql_wsrep_sync_wait = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.pool_timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.retry_interval = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.slave_connection = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.sqlite_synchronous = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.synchronous_reader = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] database.use_db_reconnect = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.connection_string = messaging:// {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.es_doc_type = notification {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.es_scroll_size = 10000 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.es_scroll_time = 2m {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.filter_error_trace = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.hmac_keys = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.sentinel_service_name = mymaster {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.socket_timeout = 0.1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.trace_requests = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler.trace_sqlalchemy = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler_jaeger.process_tags = {} {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler_jaeger.service_name_prefix = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] profiler_otlp.service_name_prefix = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.enforce_new_defaults = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.enforce_scope = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.policy_default_rule = default {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.policy_file = policy.yaml {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.group = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.helper_command = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] privsep_osbrick.user = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.group = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.helper_command = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] cinder_sys_admin.user = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.auth_section = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.auth_type = password {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.cafile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.collect_timing = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.send_service_user_token = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.split_loggers = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] service_user.timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.auth_section = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.auth_type = password {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.collect_timing = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.region_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.split_loggers = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] glance.timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.backend_availability_zone = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.chap_password = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.chap_username = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.disk_geometry = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_client_cert = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_client_cert_key = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_data_namespace = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.driver_use_ssl = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.extra_capabilities = {} {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.filter_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.goodness_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iscsi_target_flags = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iscsi_write_cache = on {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iser_helper = tgtadm {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iser_ip_address = 192.168.122.86 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iser_port = 3260 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.lvm_share_target = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.lvm_type = auto {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.num_shell_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.replication_device = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.report_discard_supported = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.reserved_percentage = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_helper = tgtadm {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_ip_address = 192.168.122.86 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_port = 3260 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_protocol = iscsi {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.trace_flags = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.unique_fqdn_network = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.use_chap_auth = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_backend_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_clear = zero {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_clear_ionice = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_clear_size = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_reports.file_event_handler = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_reports.log_dir = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.backend_host = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.chap_password = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.chap_username = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.disk_geometry = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_client_cert = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.extra_capabilities = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.filter_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.goodness_function = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iser_helper = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iser_ip_address = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iser_port = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.lvm_share_target = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.lvm_type = auto {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.num_shell_tries = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.replication_device = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.report_discard_supported = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.reserved_percentage = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.scst_target_driver = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.storage_protocol = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_helper = lioadm {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_ip_address = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_port = 3260 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.trace_flags = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.use_chap_auth = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_clear = zero {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_clear_size = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] lvmdriver-1.volumes_dir = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_notifications.driver = [] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_notifications.retry = -1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] key_manager.fixed_key = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.barbican_api_version = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.barbican_endpoint = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.barbican_endpoint_type = public {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.barbican_region_name = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.cafile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.collect_timing = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.number_of_retries = 60 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.retry_delay = 1 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.send_service_user_token = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.split_loggers = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.verify_ssl = True {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican.verify_ssl_path = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.auth_section = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.auth_type = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.cafile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.certfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.collect_timing = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.insecure = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.keyfile = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.split_loggers = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] barbican_service_user.timeout = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.approle_role_id = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.approle_secret_id = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.kv_mountpoint = secret {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.kv_path = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.kv_version = 2 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.namespace = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.root_token_id = **** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack sudo[76176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.ssl_ca_crt_file = None {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.timeout = 60.0 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.use_ssl = False {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:09:12 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] ******************************************************************************** {{(pid=76003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:09:12 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:13 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:13 devstack sudo[76372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:13 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:14 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.660s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:09:14 devstack cinder-volume[76172]: INFO cinder.brick.local_dev.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:14 devstack sudo[76587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:14 devstack sudo[76587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:14 devstack sudo[76587]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG cinder.brick.local_dev.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76172) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 09:09:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:14 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:14 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:16 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.175s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:16 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:16 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:16 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.789s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:16 devstack sudo[76955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 09:09:17 devstack sudo[76955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:17 devstack sudo[76955]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:17 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.843s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:17 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:17 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:17 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:18 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:18 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.861s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:18 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:18 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:18 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:19 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:19 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:19 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:19 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:19 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:20 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:20 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.863s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:20 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:20 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:20 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:21 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.718s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:21 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:21 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:21 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.782s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:21 devstack cinder-volume[76172]: INFO cinder.volume.drivers.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:21 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:21 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:21 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:22 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:22 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:22 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:09:22 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:22 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:22 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:22 devstack cinder-volume[76003]: DEBUG dbcounter [-] [76003] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:09:23 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:23 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:23 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:23 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:23 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:23 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:23 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:23 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:23 devstack sudo[77269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:23 devstack sudo[77269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:24 devstack sudo[77269]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:24 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:24 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:24 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:24 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:25 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:25 devstack cinder-volume[76172]: INFO cinder.volume.driver [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG cinder.volume.driver [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76172) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG oslo_db.sqlalchemy.engines [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76172) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writer thread running {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG cinder.db.api [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Building query based on filter {{(pid=76172) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG cinder.image.image_utils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76172) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:09:25 devstack cinder-volume[76172]: INFO cinder.keymgr.migration [None req-d5d6e5fe-1fd0-4579-94f0-14066ae53f77 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:25 devstack sudo[77277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:25 devstack sudo[77277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:25 devstack sudo[77277]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:25 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:25 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:25 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:26 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:26 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:26 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:27 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:27 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:27 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:27 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:09:27 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Driver initialization completed successfully. Jul 09 09:09:27 devstack cinder-volume[76172]: INFO cinder.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Initiating service 2 cleanup Jul 09 09:09:27 devstack cinder-volume[76172]: INFO cinder.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Service 2 cleanup completed. Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG cinder.service [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Creating RPC server for service cinder-volume {{(pid=76172) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG cinder.service [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76172) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:09:27 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:09:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:27 devstack sudo[77295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:09:27 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:28 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:28 devstack sudo[77298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:28 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:29 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:29 devstack sudo[77348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:09:29 devstack sudo[77348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:30 devstack sudo[77348]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:09:30 devstack sudo[77361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:09:30 devstack sudo[77361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:09:30 devstack sudo[77361]: pam_unix(sudo:session): session closed for user root Jul 09 09:09:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:09:30 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-02ee895b-4cb8-4ba7-a138-ea36d4d753de None None] Driver post RPC initialization completed successfully. Jul 09 09:09:32 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:09:32 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:09:32 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread info: [<_MainThread(MainThread, started 125730247815296)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:09:40 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:09:40 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:10:32 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:10:32 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:10:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:10:32 devstack sudo[79096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:10:32 devstack sudo[79096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:10:33 devstack sudo[79096]: pam_unix(sudo:session): session closed for user root Jul 09 09:10:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:10:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:10:33 devstack sudo[79099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:10:33 devstack sudo[79099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:10:33 devstack sudo[79099]: pam_unix(sudo:session): session closed for user root Jul 09 09:10:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:10:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:10:33 devstack sudo[79120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:10:33 devstack sudo[79120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:10:34 devstack sudo[79120]: pam_unix(sudo:session): session closed for user root Jul 09 09:10:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:10:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:10:34 devstack sudo[79123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:10:34 devstack sudo[79123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:10:35 devstack sudo[79123]: pam_unix(sudo:session): session closed for user root Jul 09 09:10:35 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:10:35 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:10:35 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:10:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:10:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread info: [<_MainThread(MainThread, started 125730247815296)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:11:32 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:11:32 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:11:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:11:32 devstack sudo[82455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:11:32 devstack sudo[82455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:11:33 devstack sudo[82455]: pam_unix(sudo:session): session closed for user root Jul 09 09:11:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:11:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:11:33 devstack sudo[82465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:11:33 devstack sudo[82465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:11:33 devstack sudo[82465]: pam_unix(sudo:session): session closed for user root Jul 09 09:11:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:11:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:11:34 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:11:34 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:11:34 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Jul 09 09:11:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:11:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:11:34 devstack sudo[82491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:11:34 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:11:35 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root Jul 09 09:11:35 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:11:35 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:11:35 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:11:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:11:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread info: [<_MainThread(MainThread, started 125730247815296)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:11:40 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:12:32 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:12:32 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:12:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:12:32 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:12:32 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:12:33 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Jul 09 09:12:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:12:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:12:33 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:12:33 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:12:34 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Jul 09 09:12:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:12:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:12:34 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:12:34 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:12:34 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Jul 09 09:12:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:12:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:12:34 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:12:34 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:12:35 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Jul 09 09:12:35 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:12:35 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:12:35 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:12:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:12:35 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] thread info: [<_MainThread(MainThread, started 125730247815296)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:13:32 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:13:32 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:13:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:32 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:13:32 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:33 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:33 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:13:33 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:33 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:33 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:13:33 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:34 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:34 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:13:34 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:35 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:35 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:35 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-bc050da3-8d4b-4d93-901d-732955a2583e None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:13:40 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:13:47 devstack cinder-volume[76003]: INFO oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Caught SIGTERM, stopping children Jul 09 09:13:47 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Acquiring lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:13:47 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Acquired lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:13:47 devstack cinder-volume[76003]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Releasing lock "singleton_lock" {{(pid=76003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:13:47 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Stop services. {{(pid=76003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 09:13:47 devstack cinder-volume[76003]: DEBUG oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Killing children. {{(pid=76003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 09:13:47 devstack cinder-volume[76003]: INFO oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Waiting on 1 children to exit Jul 09 09:13:52 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Acquiring lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:13:52 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Acquired lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:13:52 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Releasing lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:13:52 devstack cinder-volume[76172]: WARNING amqp [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:13:52 devstack cinder-volume[76172]: WARNING amqp [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:13:52 devstack cinder-volume[76003]: INFO oslo_service.backend._eventlet.service [None req-5f971603-abcf-422d-91e9-63ee0b2edd7e None None] Child 76172 exited with status 0 Jul 09 09:13:53 devstack cinder-volume[86271]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:13:53 devstack cinder-volume[86271]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:13:53 devstack cinder-volume[86271]: we strongly recommend against using it for new projects. Jul 09 09:13:53 devstack cinder-volume[86271]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:13:53 devstack cinder-volume[86271]: framework. For more detail see Jul 09 09:13:53 devstack cinder-volume[86271]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:13:53 devstack cinder-volume[86271]: import eventlet # noqa Jul 09 09:13:55 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:13:55 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:13:55 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:13:55 devstack cinder-volume[86271]: INFO dbcounter [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Registered counter for database cinder Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_db.sqlalchemy.engines [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG dbcounter [-] [86271] Writer thread running {{(pid=86271) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:13:56 devstack cinder-volume[86271]: INFO cinder.rpc [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:13:56 devstack cinder-volume[86271]: INFO cinder.rpc [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_db.sqlalchemy.engines [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:13:56 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Determined volume DB was empty at startup. Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG cinder.volume.manager [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86271) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:13:56 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 09:13:56 devstack cinder-volume[86271]: WARNING stevedore.named [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:13:56 devstack cinder-volume[86271]: WARNING castellan.key_manager [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:13:56 devstack cinder-volume[86271]: WARNING cinder.keymgr.conf_key_mgr [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:13:56 devstack cinder-volume[86271]: INFO cinder.volume.manager [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_db.sqlalchemy.engines [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:13:56 devstack cinder-volume[86271]: INFO oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Starting 1 workers Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Started child 86489 {{(pid=86271) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Full set of CONF: {{(pid=86271) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] ******************************************************************************** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Configuration options gathered from: {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] ================================================================================ {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] allow_availability_zone_fallback = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] allow_compression_on_image_upload = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] allowed_direct_url_schemes = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] api_rate_limit = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] auth_strategy = keystone {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86489]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_availability_zone = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_host = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_stats_polling_interval = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backup_api_class = cinder.backup.api.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backup_name_template = backup-%s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backup_use_same_host = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backup_use_temp_snapshot = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] chap_password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] chap_username = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_internal_tenant_project_id = 83a6d612873349fdb72ac5cfacb6be25 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_internal_tenant_user_id = bb5b30f3775242d7b365d6cd039b675a {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cluster = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] compression_format = gzip {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] config_dir = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] config_source = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] control_exchange = openstack {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] debug = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] default_availability_zone = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] default_group_type = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] default_volume_type = QuobyteHD {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] disk_geometry = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_client_cert = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_client_cert_key = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_data_namespace = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_ssl_cert_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_ssl_cert_verify = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] driver_use_ssl = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] enable_new_services = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] enable_unsupported_driver = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] enforce_multipath_for_image_xfer = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] filter_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_api_insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_api_servers = ['http://192.168.122.86/image'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_api_ssl_compression = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_ca_certificates_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_num_retries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance_request_timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] goodness_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] graceful_shutdown_timeout = 5 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] group_api_class = cinder.group.api.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] host = devstack {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_compress_on_upload = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_conversion_address_space_limit = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_conversion_cpu_limit = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_conversion_disable = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_upload_use_cinder_backend = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_upload_use_internal_tenant = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_volume_cache_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_volume_cache_max_count = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] init_host_max_objects_retrieval = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] instance_format = [instance: %(uuid)s] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iscsi_target_flags = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iscsi_write_cache = on {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iser_helper = tgtadm {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iser_ip_address = 192.168.122.86 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iser_port = 3260 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_color = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_config_append = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_dir = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_options = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_rotate_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_rotate_interval_type = days {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] log_rotation_type = none {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86489) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] max_age = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] max_logfile_count = 30 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] max_logfile_size_mb = 200 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] max_over_subscription_ratio = 20.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] message_reap_interval = 86400 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] message_ttl = 2592000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] monkey_patch = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] monkey_patch_modules = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] my_ip = 192.168.122.86 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] no_snapshot_gb_quota = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] num_iser_scan_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] num_shell_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] num_volume_device_scan_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] nvmeof_conn_info_version = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] nvmet_ns_id = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] nvmet_port_id = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_max_limit = 1000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_ext_list = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_listen_port = 8776 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_use_ssl = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] osapi_volume_workers = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] per_volume_size_limit = -1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] periodic_fuzzy_delay = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] periodic_interval = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] public_endpoint = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] publish_errors = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_backup_gigabytes = 1000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_backups = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_gigabytes = 1000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_groups = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_snapshots = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] quota_volumes = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] rate_limit_burst = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] rate_limit_except_level = CRITICAL {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] rate_limit_interval = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] reinit_driver_count = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] replication_device = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] report_discard_supported = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] report_interval = 120 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] reservation_clean_interval = 86400 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] reservation_expire = 86400 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] reserved_image_namespaces = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] reserved_percentage = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] rpc_response_timeout = 120 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] run_external_periodic_tasks = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] scst_target_driver = iscsi {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] scst_target_iqn_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_down_time = 720 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] shell_completion = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] snapshot_name_template = snapshot-%s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] split_loggers = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] state_path = /opt/stack/data/cinder {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] storage_availability_zone = nova {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] storage_protocol = iSCSI {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] syslog_log_facility = LOG_USER {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_helper = lioadm {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_ip_address = 192.168.122.86 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_port = 3260 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_protocol = iscsi {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] target_secondary_ip_addresses = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] trace_flags = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] transport_url = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] until_refresh = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_chap_auth = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_default_quota_class = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_journal = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_json = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_multipath_for_image_xfer = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_stderr = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] use_syslog = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] verify_glance_signatures = enabled {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_api_class = cinder.volume.api.API {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_backend_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_clear = zero {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_clear_ionice = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_clear_size = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_copy_bps_limit = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_dd_blocksize = 1M {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_name_template = volume-%s {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_service_inithost_offload = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volume_usage_audit_period = month {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] zoning_mode = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.auth_section = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.auth_type = password {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.auth_version = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.cache = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.interface = public {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_password = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcache_username = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.region_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.service_type = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.86/identity {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.backend = dogpile.cache.null {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.backend_argument = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.backend_expiration_time = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.config_prefix = cache.oslo {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.debug_cache_backend = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.enable_retry_client = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.enable_socket_keepalive = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.expiration_time = 600 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_dead_retry = 300 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_sasl_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.proxies = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.redis_db = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.redis_server = localhost:6379 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.retry_attempts = 2 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.retry_delay = 0.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.socket_keepalive_count = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.socket_keepalive_idle = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.socket_keepalive_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.socket_timeout = 1.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.tls_allowed_ciphers = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.tls_cafile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.tls_certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.tls_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86489) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 09:13:56 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 09:13:56 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.tls_keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cache.username = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] coordination.backend_url = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.asyncio_connection = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.asyncio_slave_connection = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.backend = sqlalchemy {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Running cmd (subprocess): mount.quobyte {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.connection = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.connection_debug = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.connection_parameters = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.connection_recycle_time = 3600 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.connection_trace = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.db_inc_retry_interval = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.db_max_retries = 20 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.db_max_retry_interval = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.db_retry_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.max_overflow = 50 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.max_pool_size = 5 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.max_retries = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.pool_timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.retry_interval = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.slave_connection = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.sqlite_synchronous = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.synchronous_reader = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] database.use_db_reconnect = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.connection_string = messaging:// {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.es_doc_type = notification {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.es_scroll_size = 10000 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.es_scroll_time = 2m {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.filter_error_trace = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.hmac_keys = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.sentinel_service_name = mymaster {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.socket_timeout = 0.1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.trace_requests = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler.trace_sqlalchemy = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler_jaeger.process_tags = {} {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] profiler_otlp.service_name_prefix = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.enforce_scope = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.policy_default_rule = default {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.group = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.helper_command = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] privsep_osbrick.user = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.group = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.helper_command = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] cinder_sys_admin.user = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.auth_section = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.auth_type = password {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:56 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.cafile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.collect_timing = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.send_service_user_token = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.split_loggers = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] service_user.timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.auth_section = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.auth_type = password {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.collect_timing = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.region_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.split_loggers = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] glance.timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.backend_availability_zone = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.chap_password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.chap_username = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.disk_geometry = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_client_cert = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_data_namespace = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.driver_use_ssl = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.extra_capabilities = {} {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.filter_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.goodness_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iscsi_target_flags = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iser_ip_address = 192.168.122.86 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iser_port = 3260 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_host = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_login = admin {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_mount_options = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_private_key = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_share_path = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.replication_device = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.report_discard_supported = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_helper = tgtadm {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_ip_address = 192.168.122.86 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_port = 3260 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_protocol = iscsi {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.trace_flags = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.use_chap_auth = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_backend_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_clear = zero {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_reports.file_event_handler = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_reports.log_dir = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.backend_host = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.chap_password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.chap_username = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.disk_geometry = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_client_cert = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.extra_capabilities = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.filter_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.goodness_function = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iser_helper = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iser_ip_address = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iser_port = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_host = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_login = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_mount_options = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_password = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_private_key = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_share_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.num_shell_tries = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.replication_device = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.report_discard_supported = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.reserved_percentage = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.scst_target_driver = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.storage_protocol = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_helper = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_ip_address = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_port = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_prefix = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_protocol = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.trace_flags = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.use_chap_auth = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_clear = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_clear_size = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] QuobyteHD.volumes_dir = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_notifications.driver = [] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] key_manager.fixed_key = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.barbican_api_version = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack quobyte-client[86492]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.barbican_endpoint = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.barbican_endpoint_type = public {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.barbican_region_name = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.cafile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack quobyte-client[86492]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.collect_timing = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.number_of_retries = 60 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.retry_delay = 1 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.send_service_user_token = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.split_loggers = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.verify_ssl = True {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican.verify_ssl_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.auth_section = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.auth_type = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.cafile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.certfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.collect_timing = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.insecure = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.keyfile = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.split_loggers = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] barbican_service_user.timeout = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.approle_role_id = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.approle_secret_id = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.kv_mountpoint = secret {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.kv_path = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.kv_version = 2 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.namespace = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.root_token_id = **** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.ssl_ca_crt_file = None {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.timeout = 60.0 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: INFO cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd ... Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.use_ssl = False {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec -c /etc/quobyte/client-cinder.cfg {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:13:57 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] ******************************************************************************** {{(pid=86271) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:13:57 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec -c /etc/quobyte/client-cinder.cfg Jul 09 09:13:57 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:57 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.803s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:57 devstack cinder-volume[86489]: INFO cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd succeeded Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.818s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:13:57 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:57 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:13:57 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:58 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.627s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:58 devstack cinder-volume[86489]: INFO cinder.volume.driver [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG cinder.volume.driver [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7022171020508, 'free_capacity_gb': 1775.7022171020508, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writer thread running {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG cinder.db.api [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Building query based on filter {{(pid=86489) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86489) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:13:58 devstack cinder-volume[86489]: INFO cinder.keymgr.migration [None req-606523a1-e250-4808-abe1-9c9d5ebfd27b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:13:58 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:58 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:13:58 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:13:59 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.744s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:13:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Driver initialization completed successfully. Jul 09 09:13:59 devstack cinder-volume[86489]: INFO cinder.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Initiating service 3 cleanup Jul 09 09:13:59 devstack cinder-volume[86489]: INFO cinder.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Service 3 cleanup completed. Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG cinder.service [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Creating RPC server for service cinder-volume {{(pid=86489) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG cinder.service [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86489) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:13:59 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:13:59 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:13:59 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:13:59 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:14:00 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Jul 09 09:14:00 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.830s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:00 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-e05ddbee-dec3-4f75-9056-b916a1872273 None None] Driver post RPC initialization completed successfully. Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:14:03 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:14:03 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:14:03 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:14:04 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Jul 09 09:14:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.587s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:04 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-db8416a4-4796-42eb-9eae-e9e34f373d51 None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:14:06 devstack cinder-volume[86271]: INFO oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Caught SIGTERM, stopping children Jul 09 09:14:06 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Acquiring lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:14:06 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Acquired lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:14:06 devstack cinder-volume[86271]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Releasing lock "singleton_lock" {{(pid=86271) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:14:06 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Stop services. {{(pid=86271) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 09:14:06 devstack cinder-volume[86271]: DEBUG oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Killing children. {{(pid=86271) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 09:14:06 devstack cinder-volume[86271]: INFO oslo_service.backend._eventlet.service [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Waiting on 1 children to exit Jul 09 09:14:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:14:10 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:14:11 devstack cinder-volume[86489]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 09 09:14:12 devstack cinder-volume[87023]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:14:12 devstack cinder-volume[87023]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:14:12 devstack cinder-volume[87023]: we strongly recommend against using it for new projects. Jul 09 09:14:12 devstack cinder-volume[87023]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:14:12 devstack cinder-volume[87023]: framework. For more detail see Jul 09 09:14:12 devstack cinder-volume[87023]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:14:12 devstack cinder-volume[87023]: import eventlet # noqa Jul 09 09:14:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Acquiring lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:14:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Acquired lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:14:12 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Releasing lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:14:12 devstack cinder-volume[86489]: WARNING amqp [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:14:12 devstack cinder-volume[86489]: WARNING amqp [None req-2dda9277-d2e9-496e-9b32-61c15044bde3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:14:14 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:14:14 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:14:14 devstack cinder-volume[87023]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:14:15 devstack cinder-volume[87023]: INFO dbcounter [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Registered counter for database cinder Jul 09 09:14:15 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:14:15 devstack cinder-volume[87023]: DEBUG dbcounter [-] [87023] Writer thread running {{(pid=87023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:14:15 devstack cinder-volume[87023]: INFO cinder.rpc [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:14:15 devstack cinder-volume[87023]: INFO cinder.rpc [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:14:15 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:14:15 devstack cinder-volume[87023]: INFO cinder.volume.manager [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Determined volume DB was empty at startup. Jul 09 09:14:15 devstack cinder-volume[87023]: DEBUG cinder.volume.manager [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87023) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:14:15 devstack cinder-volume[87023]: WARNING stevedore.named [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:14:15 devstack cinder-volume[87023]: WARNING castellan.key_manager [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:14:15 devstack cinder-volume[87023]: WARNING cinder.keymgr.conf_key_mgr [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:14:15 devstack cinder-volume[87023]: INFO cinder.volume.manager [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 09:14:15 devstack cinder-volume[87023]: DEBUG oslo_db.sqlalchemy.engines [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:14:16 devstack cinder-volume[87023]: INFO oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Starting 1 workers Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Started child 87265 {{(pid=87023) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Full set of CONF: {{(pid=87023) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] ******************************************************************************** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] Configuration options gathered from: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] ================================================================================ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] allow_availability_zone_fallback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] allow_compression_on_image_upload = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87265]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] allowed_direct_url_schemes = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] api_rate_limit = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] auth_strategy = keystone {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_host = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_stats_polling_interval = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backup_api_class = cinder.backup.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backup_name_template = backup-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backup_use_same_host = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backup_use_temp_snapshot = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] chap_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] chap_username = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_internal_tenant_project_id = 83a6d612873349fdb72ac5cfacb6be25 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_internal_tenant_user_id = bb5b30f3775242d7b365d6cd039b675a {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cluster = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] compression_format = gzip {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] compute_api_class = cinder.compute.nova.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] config_dir = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] config_source = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] control_exchange = openstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] debug = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] default_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] default_group_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] default_volume_type = QuobyteHD {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] disk_geometry = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_client_cert = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_client_cert_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_data_namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_ssl_cert_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_ssl_cert_verify = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] driver_use_ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] enable_new_services = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] enable_unsupported_driver = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] enabled_backends = ['QuobyteHD'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] enforce_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] filter_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_api_insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_api_servers = ['http://192.168.122.86/image'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_api_ssl_compression = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_ca_certificates_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_catalog_info = image:glance:publicURL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_num_retries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance_request_timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] goodness_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] graceful_shutdown_timeout = 5 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] group_api_class = cinder.group.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] host = devstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_compress_on_upload = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_conversion_address_space_limit = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_conversion_cpu_limit = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_conversion_disable = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_upload_use_cinder_backend = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_upload_use_internal_tenant = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_volume_cache_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_volume_cache_max_count = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] image_volume_cache_max_size_gb = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] init_host_max_objects_retrieval = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] instance_format = [instance: %(uuid)s] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iscsi_target_flags = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iscsi_write_cache = on {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iser_helper = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iser_ip_address = 192.168.122.86 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iser_port = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_color = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_config_append = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_dir = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_options = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_rotate_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_rotate_interval_type = days {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] log_rotation_type = none {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] max_age = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] max_logfile_count = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] max_logfile_size_mb = 200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] max_over_subscription_ratio = 20.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] message_reap_interval = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] message_ttl = 2592000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] migration_create_volume_timeout_secs = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] monkey_patch = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] monkey_patch_modules = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] my_ip = 192.168.122.86 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] no_snapshot_gb_quota = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] num_iser_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] num_shell_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] num_volume_device_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] nvmeof_conn_info_version = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] nvmet_ns_id = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] nvmet_port_id = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_max_limit = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_ext_list = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_listen_port = 8776 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_use_ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] osapi_volume_workers = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] per_volume_size_limit = -1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] periodic_fuzzy_delay = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] periodic_interval = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87265) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] public_endpoint = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] publish_errors = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_backup_gigabytes = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_backups = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_gigabytes = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_groups = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_snapshots = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] quota_volumes = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] rate_limit_burst = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] rate_limit_except_level = CRITICAL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] rate_limit_interval = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] reinit_driver_count = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] replication_device = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] report_discard_supported = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] report_interval = 120 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] reservation_clean_interval = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] reservation_expire = 86400 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] reserved_image_namespaces = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] reserved_percentage = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] rpc_response_timeout = 120 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] run_external_periodic_tasks = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] scst_target_driver = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] scst_target_iqn_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_down_time = 720 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] shell_completion = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] snapshot_name_template = snapshot-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] state_path = /opt/stack/data/cinder {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] storage_availability_zone = nova {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] storage_protocol = iSCSI {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] syslog_log_facility = LOG_USER {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_helper = lioadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_ip_address = 192.168.122.86 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_port = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_protocol = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] target_secondary_ip_addresses = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] trace_flags = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] transport_url = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] until_refresh = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_chap_auth = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_default_quota_class = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_journal = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_json = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_stderr = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] use_syslog = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] verify_glance_signatures = enabled {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_api_class = cinder.volume.api.API {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_backend_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_clear = zero {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_clear_ionice = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_clear_size = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_copy_bps_limit = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_dd_blocksize = 1M {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_name_template = volume-%s {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_service_inithost_offload = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volume_usage_audit_period = month {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] zoning_mode = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_concurrency.disable_process_locking = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.auth_type = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.auth_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.cache = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.include_service_catalog = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.interface = public {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_password = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcache_username = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.region_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.service_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.86/identity {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.backend = dogpile.cache.null {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.backend_argument = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.backend_expiration_time = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.config_prefix = cache.oslo {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.debug_cache_backend = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.enable_retry_client = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.enable_socket_keepalive = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.expiration_time = 600 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.hashclient_retry_attempts = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_dead_retry = 300 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_pool_maxsize = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_sasl_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.proxies = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.redis_db = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.redis_server = localhost:6379 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.retry_attempts = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.retry_delay = 0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.socket_keepalive_count = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.socket_keepalive_idle = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.socket_keepalive_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.socket_timeout = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.tls_allowed_ciphers = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.tls_cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.tls_certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.tls_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.tls_keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cache.username = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] coordination.backend_url = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.asyncio_connection = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.asyncio_slave_connection = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.backend = sqlalchemy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.connection = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.connection_debug = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.connection_parameters = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.connection_recycle_time = 3600 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.connection_trace = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.db_inc_retry_interval = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.db_max_retries = 20 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.db_max_retry_interval = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.db_retry_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.max_overflow = 50 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.max_pool_size = 5 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.max_retries = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.mysql_wsrep_sync_wait = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.pool_timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.retry_interval = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.slave_connection = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.sqlite_synchronous = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.synchronous_reader = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] database.use_db_reconnect = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.connection_string = messaging:// {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.es_doc_type = notification {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.es_scroll_size = 10000 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.es_scroll_time = 2m {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.filter_error_trace = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.hmac_keys = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.sentinel_service_name = mymaster {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.socket_timeout = 0.1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.trace_requests = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler.trace_sqlalchemy = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler_jaeger.process_tags = {} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler_jaeger.service_name_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] profiler_otlp.service_name_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.enforce_new_defaults = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.enforce_scope = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.policy_default_rule = default {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.policy_file = policy.yaml {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.group = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.helper_command = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] privsep_osbrick.user = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.group = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.helper_command = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87265) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] cinder_sys_admin.user = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.auth_type = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.collect_timing = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.send_service_user_token = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] service_user.timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.auth_type = password {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.collect_timing = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.region_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] glance.timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.backend_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.chap_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.chap_username = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.disk_geometry = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_client_cert = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_client_cert_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_data_namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.driver_use_ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.extra_capabilities = {} {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.filter_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.goodness_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iscsi_target_flags = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iscsi_write_cache = on {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iser_helper = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iser_ip_address = 192.168.122.86 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iser_port = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_host = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_login = admin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_mount_options = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_private_key = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_share_path = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.num_shell_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.quobyte_volume_url = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.replication_device = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.report_discard_supported = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.reserved_percentage = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_helper = tgtadm {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_ip_address = 192.168.122.86 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_port = 3260 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_protocol = iscsi {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.trace_flags = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.unique_fqdn_network = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.use_chap_auth = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_backend_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_clear = zero {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_clear_ionice = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_clear_size = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_reports.file_event_handler = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_reports.log_dir = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.backend_availability_zone = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.backend_host = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.chap_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.chap_username = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.chiscsi_conf = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.disk_geometry = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_client_cert = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_data_namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.driver_use_ssl = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.extra_capabilities = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.filter_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.goodness_function = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iser_helper = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iser_ip_address = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iser_port = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.iser_target_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_host = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_login = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_mount_options = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_password = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_private_key = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_share_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_ssh_port = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.num_shell_tries = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.nvmet_port_id = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.replication_device = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.report_discard_supported = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.reserved_percentage = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.scst_target_driver = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.storage_protocol = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_helper = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_ip_address = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_port = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_prefix = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_protocol = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.trace_flags = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.use_chap_auth = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_clear = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_clear_size = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] QuobyteHD.volumes_dir = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_notifications.driver = [] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_notifications.retry = -1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] key_manager.fixed_key = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.barbican_api_version = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.barbican_endpoint = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.barbican_endpoint_type = public {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.barbican_region_name = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.collect_timing = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.number_of_retries = 60 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.retry_delay = 1 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.send_service_user_token = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.verify_ssl = True {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican.verify_ssl_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.auth_section = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.auth_type = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.cafile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.certfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.collect_timing = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.insecure = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.keyfile = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.split_loggers = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] barbican_service_user.timeout = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.approle_role_id = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.approle_secret_id = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.kv_mountpoint = secret {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.kv_path = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.kv_version = 2 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.namespace = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.root_token_id = **** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.ssl_ca_crt_file = None {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.timeout = 60.0 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.use_ssl = False {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:14:16 devstack cinder-volume[87023]: DEBUG oslo_service.backend._eventlet.service [None req-402b6615-58b4-4c70-aa74-75a8fc552284 None None] ******************************************************************************** {{(pid=87023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:14:16 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:14:16 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:14:16 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.633s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:16 devstack cinder-volume[87265]: INFO cinder.volume.driver [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.volume.driver [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7022171020508, 'free_capacity_gb': 1775.7022171020508, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87265) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG oslo_db.sqlalchemy.engines [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writer thread running {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:14:16 devstack cinder-volume[87265]: DEBUG cinder.db.api [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Building query based on filter {{(pid=87265) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87265) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:14:17 devstack cinder-volume[87265]: INFO cinder.keymgr.migration [None req-a514f168-f9ed-48e5-9854-57f38e49ac82 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:14:17 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:14:17 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:14:17 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.626s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:14:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Driver initialization completed successfully. Jul 09 09:14:17 devstack cinder-volume[87265]: INFO cinder.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Initiating service 3 cleanup Jul 09 09:14:17 devstack cinder-volume[87265]: INFO cinder.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Service 3 cleanup completed. Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.service [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Creating RPC server for service cinder-volume {{(pid=87265) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.service [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87265) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:14:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:14:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:14:17 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:14:17 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:14:18 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Jul 09 09:14:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.621s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:14:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c19daed8-5f21-4012-86c5-c66ccd6648f2 None None] Driver post RPC initialization completed successfully. Jul 09 09:14:26 devstack cinder-volume[87023]: DEBUG dbcounter [-] [87023] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:14:27 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:14:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:14:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:14:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 6 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:14:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Flow 'volume_create_manager' (2f29af86-6f59-4f86-8ff4-c747d0f43924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5241f5f2-7a6d-4b19-95ca-29af58c62976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5241f5f2-7a6d-4b19-95ca-29af58c62976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272499568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eeeb84a-75d5-43b2-b72b-aab7169e71e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb685064cac4607b817f7325f9ffc1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:16Z,use_quota=True,user_id='13ac2d849c1e4ef08080c4781f7bb419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bec3c8-9927-4df6-9207-2705cf8204f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bec3c8-9927-4df6-9207-2705cf8204f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f640fcf6-134d-49f4-8130-ba42f05e5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f640fcf6-134d-49f4-8130-ba42f05e5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eeeb84a-75d5-43b2-b72b-aab7169e71e1', 'volume_name': 'volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae184210-8e3f-4b03-ac8a-8dce421c1903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae184210-8e3f-4b03-ac8a-8dce421c1903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e667ffa-e70e-4b8b-9fe7-a42a8285e97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Volume 1eeeb84a-75d5-43b2-b72b-aab7169e71e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1', 'volume_size': 1} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272499568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eeeb84a-75d5-43b2-b72b-aab7169e71e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb685064cac4607b817f7325f9ffc1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:16Z,use_quota=True,user_id='13ac2d849c1e4ef08080c4781f7bb419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Creating volume 1eeeb84a-75d5-43b2-b72b-aab7169e71e1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:15:16 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:15:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:16 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 1073741824 Jul 09 09:15:16 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:17 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 1073741824" returned: 0 in 1.272s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:18 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 Jul 09 09:15:18 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:18 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" returned: 0 in 0.940s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e667ffa-e70e-4b8b-9fe7-a42a8285e97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9018695-37b7-4871-9bf4-d1798024dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:19 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Volume volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 (1eeeb84a-75d5-43b2-b72b-aab7169e71e1): created successfully Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9018695-37b7-4871-9bf4-d1798024dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Flow 'volume_create_manager' (2f29af86-6f59-4f86-8ff4-c747d0f43924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e1992573-0721-467d-acf9-63ae0210941c tempest-TaggedAttachmentsTest-801533008 None] Created volume successfully. Jul 09 09:15:29 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:15:29 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Flow 'volume_create_manager' (df5863b2-45c2-4720-b431-58a69f79194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d87eb0-17ea-41df-92cd-89a83a37a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d87eb0-17ea-41df-92cd-89a83a37a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2014504343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1577176-5af7-40ce-a566-c2d1cb8c5d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df616dd72ce04c348b4aa02d84979e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:46Z,use_quota=True,user_id='b9e71d6cba6248f5b9388f1d0dbead52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6487c2-d2b2-4093-ab90-b983f54ea60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6487c2-d2b2-4093-ab90-b983f54ea60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2310e250-0e63-4ce3-8fc9-98e3e42cdbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2310e250-0e63-4ce3-8fc9-98e3e42cdbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1577176-5af7-40ce-a566-c2d1cb8c5d26', 'volume_name': 'volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df89bb-402c-423e-8636-a9ed8c0d23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df89bb-402c-423e-8636-a9ed8c0d23e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15ad02-4237-45b6-b58b-15a76636f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Volume d1577176-5af7-40ce-a566-c2d1cb8c5d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26', 'volume_size': 1} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2014504343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1577176-5af7-40ce-a566-c2d1cb8c5d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df616dd72ce04c348b4aa02d84979e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:46Z,use_quota=True,user_id='b9e71d6cba6248f5b9388f1d0dbead52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Creating volume d1577176-5af7-40ce-a566-c2d1cb8c5d26 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:15:46 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:46 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 1073741824 Jul 09 09:15:46 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Flow 'volume_create_manager' (ae5a9b3a-839c-48a5-87c1-b77b70fe3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974df7c0-dfce-427a-a6c9-40e89d9ee68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974df7c0-dfce-427a-a6c9-40e89d9ee68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1962759082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814219fb-5eb1-45da-8085-5f39e64990b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e22f22fe1c274d22a17fac61c799b67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:47Z,use_quota=True,user_id='2847e1d5784c48caa33d6c6e86d2c2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e50d4-48b6-4faf-ad8b-40773d6cac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e50d4-48b6-4faf-ad8b-40773d6cac7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068adf6f-5707-4ed1-b3a3-221b71c3d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068adf6f-5707-4ed1-b3a3-221b71c3d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814219fb-5eb1-45da-8085-5f39e64990b0', 'volume_name': 'volume-814219fb-5eb1-45da-8085-5f39e64990b0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a9c856-f528-4beb-930e-a07ad1e4150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a9c856-f528-4beb-930e-a07ad1e4150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada2298b-0970-4bda-8282-8e516e06b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Volume 814219fb-5eb1-45da-8085-5f39e64990b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814219fb-5eb1-45da-8085-5f39e64990b0', 'volume_size': 1} Jul 09 09:15:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:48 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 1073741824" returned: 0 in 1.556s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:48 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 Jul 09 09:15:48 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:49 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26" returned: 0 in 1.224s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.495s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1962759082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814219fb-5eb1-45da-8085-5f39e64990b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e22f22fe1c274d22a17fac61c799b67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:47Z,use_quota=True,user_id='2847e1d5784c48caa33d6c6e86d2c2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Creating volume 814219fb-5eb1-45da-8085-5f39e64990b0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:15:49 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15ad02-4237-45b6-b58b-15a76636f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9f3c52-bb48-4cf6-b787-ce5025d960c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:49 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 1073741824 Jul 09 09:15:49 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Volume volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 (d1577176-5af7-40ce-a566-c2d1cb8c5d26): created successfully Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9f3c52-bb48-4cf6-b787-ce5025d960c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Flow 'volume_create_manager' (df5863b2-45c2-4720-b431-58a69f79194a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-af4def59-773d-49ab-908a-029aa7a90abd tempest-VolumesAdminNegativeTest-1395926133 None] Created volume successfully. Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:50 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:15:50 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:50 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 1073741824" returned: 0 in 1.362s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:50 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 Jul 09 09:15:50 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Acquiring lock "cinder-d1577176-5af7-40ce-a566-c2d1cb8c5d26-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "cinder-d1577176-5af7-40ce-a566-c2d1cb8c5d26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Acquiring lock "cinder-quobyte-d1577176-5af7-40ce-a566-c2d1cb8c5d26" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "cinder-quobyte-d1577176-5af7-40ce-a566-c2d1cb8c5d26" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:15:51 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6jvkeewp/privsep.sock'] Jul 09 09:15:51 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6jvkeewp/privsep.sock Jul 09 09:15:51 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:51 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.380s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 7 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:15:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:15:52 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 09:15:52 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0" returned: 0 in 1.700s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] <== create_volume: return (3176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.181s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada2298b-0970-4bda-8282-8e516e06b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814219fb-5eb1-45da-8085-5f39e64990b0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff86da5b-8835-4e69-a8d7-1cdb8b761873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:15:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Volume volume-814219fb-5eb1-45da-8085-5f39e64990b0 (814219fb-5eb1-45da-8085-5f39e64990b0): created successfully Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff86da5b-8835-4e69-a8d7-1cdb8b761873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:15:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Flow 'volume_create_manager' (ae5a9b3a-839c-48a5-87c1-b77b70fe3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:15:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a2a2d681-d5a7-4660-a1b0-789c98c958ff req-4eff2f17-0b41-4b17-847d-276029a86cf4 tempest-VolumesGetTestJSON-1725904399 None] Created volume successfully. Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:15:53 devstack cinder-volume[87265]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 09:15:53 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:53 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Spawned new privsep daemon via rootwrap Jul 09 09:15:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Accepted privsep connection to /tmp/tmp6jvkeewp/privsep.sock {{(pid=87265) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 09:15:53 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 09:15:53 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 09:15:53 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 09:15:53 devstack cinder-volume[87265]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88229 Jul 09 09:15:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7a5b6-dfac-4012-809f-dd36a5248c0e]: (2,) {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:15:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[688576ac-7479-4b1a-9a5b-b393df781338]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:15:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Acquiring lock "cinder-814219fb-5eb1-45da-8085-5f39e64990b0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:15:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "cinder-814219fb-5eb1-45da-8085-5f39e64990b0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:15:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Acquiring lock "cinder-quobyte-814219fb-5eb1-45da-8085-5f39e64990b0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:15:54 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 Jul 09 09:15:54 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "cinder-quobyte-814219fb-5eb1-45da-8085-5f39e64990b0" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:15:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493c270-22b3-4b39-bdb2-279ea081bad5]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:15:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:54 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 Jul 09 09:15:54 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:55 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26" returned: 0 in 1.373s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:55 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26 Jul 09 09:15:55 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:55 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0" returned: 0 in 1.257s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:55 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0 Jul 09 09:15:55 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:56 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d1577176-5af7-40ce-a566-c2d1cb8c5d26" returned: 0 in 0.888s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "cinder-quobyte-d1577176-5af7-40ce-a566-c2d1cb8c5d26" released by "delete_volume" :: held 4.376s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:15:56 devstack cinder-volume[87265]: WARNING cinder.quota [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:15:56 devstack cinder-volume[87265]: WARNING cinder.quota [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Created reservations ['1a67d9a1-c182-4be8-a4f7-91cd6d6b4d8c', 'ec0ca84a-4945-4701-aa37-b8a16c59812c', '43b576df-ecf9-479c-9cfb-ba2dd40e1564', '22145a52-a218-4e0b-be32-c35fda735e1e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:56 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-814219fb-5eb1-45da-8085-5f39e64990b0" returned: 0 in 0.951s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:56 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:15:56 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "cinder-quobyte-814219fb-5eb1-45da-8085-5f39e64990b0" released by "delete_volume" :: held 2.305s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.quota [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Created reservations ['090e2c37-9c38-4b3f-8023-f27e73d450fd', '62940b7e-9e1d-47e5-88e8-9ec79befee2d', '73664a91-e25c-4534-95c1-d5a5a5f869ac', 'd11b7c19-9bd8-4368-80d8-e05432ee3922'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:15:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:15:56 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:15:56 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:15:57 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.997s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:15:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Deleted volume successfully. Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8d8c9763-ce25-438d-bd71-108f3c611d09 tempest-VolumesAdminNegativeTest-1395926133 None] Lock "cinder-d1577176-5af7-40ce-a566-c2d1cb8c5d26-delete_volume" released by "delete_volume" :: held 5.801s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:15:57 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.896s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG cinder.manager [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:15:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Deleted volume successfully. Jul 09 09:15:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-82b53fa1-9a83-424d-8213-cda9d07f35a9 req-31cac3ca-5d40-4f94-a0d0-865be3340a58 tempest-VolumesGetTestJSON-1725904399 None] Lock "cinder-814219fb-5eb1-45da-8085-5f39e64990b0-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-187c7887-c139-430e-a0b8-0950ddc4e07c tempest-BackendsCapabilitiesAdminTestsJSON-621036351 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7022171020508, 'free_capacity_gb': 1775.7022171020508, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87265) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 09:16:07 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:16:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27623719-eccb-49e9-b0c5-62c970d7ab0b tempest-BackendsCapabilitiesAdminTestsJSON-621036351 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7022171020508, 'free_capacity_gb': 1775.7022171020508, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87265) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 09:16:07 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=13,cinder:UPDATE=21,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:16:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aa2f0e83-604c-4f47-b101-c5a88301f831 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-1012575266: creating Jul 09 09:16:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aa2f0e83-604c-4f47-b101-c5a88301f831 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-1012575266: created successfully Jul 09 09:16:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aa2f0e83-604c-4f47-b101-c5a88301f831 tempest-GroupSnapshotsTest-1696846439 None] Create group completed successfully. Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (28184406-cf24-40cb-a9fd-65c2054ff102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ada79db-f136-475f-a4b1-39a4f25762b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ada79db-f136-475f-a4b1-39a4f25762b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-876369992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c02085b-549f-4ed8-b302-5ceef203d142,host='devstack@QuobyteHD#QuobyteHD',id=bbb9b690-4cc8-46ca-8b78-65c488ad81b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:15Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d9952b8-8d6b-4e1f-abaf-fccfc6716efc),volume_type_id=0d9952b8-8d6b-4e1f-abaf-fccfc6716efc)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b59609-1100-431f-b847-5a275406348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b59609-1100-431f-b847-5a275406348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349da2d1-de76-4c09-a5aa-9677d9724776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349da2d1-de76-4c09-a5aa-9677d9724776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb9b690-4cc8-46ca-8b78-65c488ad81b8', 'volume_name': 'volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c438e1c9-f7ff-48e5-ad5b-b350d861398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c438e1c9-f7ff-48e5-ad5b-b350d861398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcfa31b-1710-4acd-8792-1c3309fdce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Volume bbb9b690-4cc8-46ca-8b78-65c488ad81b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8', 'volume_size': 1} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c02085b-549f-4ed8-b302-5ceef203d142,created_at=2026-07-09T07:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-876369992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c02085b-549f-4ed8-b302-5ceef203d142,host='devstack@QuobyteHD#QuobyteHD',id=bbb9b690-4cc8-46ca-8b78-65c488ad81b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:15Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d9952b8-8d6b-4e1f-abaf-fccfc6716efc),volume_type_id=0d9952b8-8d6b-4e1f-abaf-fccfc6716efc)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Creating volume bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:14 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:16:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:14 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 1073741824 Jul 09 09:16:14 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:15 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 1073741824" returned: 0 in 1.027s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:16 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:16 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:16 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 0.683s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcfa31b-1710-4acd-8792-1c3309fdce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bbb78e-086f-47b1-bd1d-26cd8004754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Volume volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 (bbb9b690-4cc8-46ca-8b78-65c488ad81b8): created successfully Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bbb78e-086f-47b1-bd1d-26cd8004754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (28184406-cf24-40cb-a9fd-65c2054ff102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d3c2e135-4d91-4c67-a2aa-19315d6d75cc tempest-GroupSnapshotsTest-1696846439 None] Created volume successfully. Jul 09 09:16:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] GroupSnapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: creating. Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Group snapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: creating. {{(pid=87265) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Creating offline snapshot a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d of volume bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55627b-6d79-492c-b33f-23d87ea6f9fa]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:17 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:17 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:18 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:18 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d 1G Jul 09 09:16:18 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:19 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d 1G" returned: 0 in 0.839s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:19 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:19 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:20 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 0.696s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:20 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:16:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:20 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:20 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:20 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 0.675s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:20 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info Jul 09 09:16:20 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:21 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info" returned: 0 in 0.743s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:21 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:16:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:21 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info Jul 09 09:16:21 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Flow 'volume_create_manager' (6f8ebbe5-67f9-4317-ba56-025c6a75ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90020a00-9420-49e2-9467-c3a0e60d0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90020a00-9420-49e2-9467-c3a0e60d0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-491357462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eece3741-8692-4bed-9669-98b7abf31855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9a86a048924500991c017b82998135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:22Z,use_quota=True,user_id='345165c5ea67491385229bdd7f3b9ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab1bc5c-55b6-40cc-b666-dece063b9acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab1bc5c-55b6-40cc-b666-dece063b9acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18f07b-4923-464c-aaa3-271eb83d5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18f07b-4923-464c-aaa3-271eb83d5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eece3741-8692-4bed-9669-98b7abf31855', 'volume_name': 'volume-eece3741-8692-4bed-9669-98b7abf31855', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912f38be-2d58-47b3-8c28-956415ce1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912f38be-2d58-47b3-8c28-956415ce1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bae873e-ab04-4a14-8485-1e8575eb89e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Volume eece3741-8692-4bed-9669-98b7abf31855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eece3741-8692-4bed-9669-98b7abf31855', 'volume_size': 1} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:22 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.info" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.641s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-491357462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eece3741-8692-4bed-9669-98b7abf31855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9a86a048924500991c017b82998135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:22Z,use_quota=True,user_id='345165c5ea67491385229bdd7f3b9ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Creating volume eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:16:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:22 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 1073741824 Jul 09 09:16:22 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c0790a38-9c67-47e5-8a4f-34e490f45b5c tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: created successfully Jul 09 09:16:23 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 1073741824" returned: 0 in 0.996s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:23 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 Jul 09 09:16:23 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:24 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bae873e-ab04-4a14-8485-1e8575eb89e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eece3741-8692-4bed-9669-98b7abf31855', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadbf834-bf11-4742-950f-a4fa49de36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Volume volume-eece3741-8692-4bed-9669-98b7abf31855 (eece3741-8692-4bed-9669-98b7abf31855): created successfully Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadbf834-bf11-4742-950f-a4fa49de36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Flow 'volume_create_manager' (6f8ebbe5-67f9-4317-ba56-025c6a75ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cc2e8b8a-831c-4336-9091-27a202c27907 tempest-ServerActionsTestOtherA-1344017989 None] Created volume successfully. Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d-5dbd02f3-d145-465d-be98-8813b51231c8" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d-5dbd02f3-d145-465d-be98-8813b51231c8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Creating volume 5dbd02f3-d145-465d-be98-8813b51231c8 from snapshot a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] snapshot: a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d, volume: 5dbd02f3-d145-465d-be98-8813b51231c8, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30dab6b-e873-4037-99a3-ddb55eb9ee08]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:24 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:24 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:25 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 0.973s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7252348f-90e7-49be-98b5-56503b55cdf5]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:25 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:25 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:26 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 0.851s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:26 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:16:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:26 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 Jul 09 09:16:26 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:33 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8" returned: 0 in 6.657s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b468a15-a2fe-49a2-b86a-71a9e5b24e1e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:33 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:33 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:34 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 1.053s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:34 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:16:34 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Converted 1024.00 MB image at 153.80 MB/s Jul 09 09:16:34 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:16:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:34 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 Jul 09 09:16:34 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:34 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:16:34 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:16:35 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8" returned: 0 in 0.835s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" released by "_copy_volume_from_snapshot" :: held 10.522s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d-5dbd02f3-d145-465d-be98-8813b51231c8" released by "_create_volume_from_snapshot" :: held 10.566s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.588s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-216f05ab-5a4f-477e-9922-2d9a8c30a629 tempest-GroupSnapshotsTest-1696846439 None] Create group from source-snapshot-79c13392-d4a9-435a-bdd1-61a2d0bc4e36 completed successfully. Jul 09 09:16:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" acquired by "delete_volume" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb55bf-acf0-4808-a0f9-5307dbd918b5]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:36 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 Jul 09 09:16:36 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:37 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8" returned: 0 in 0.912s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:37 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8 Jul 09 09:16:37 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:38 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5dbd02f3-d145-465d-be98-8813b51231c8" returned: 0 in 0.937s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5dbd02f3-d145-465d-be98-8813b51231c8" released by "delete_volume" :: held 1.934s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['92ca0d0c-1d6b-433f-a34f-ef9989a91167'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:16:38 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2144556144 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2144556144, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:16:38 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2144556144 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2144556144, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['f0b0ef8d-910e-4e8f-af0e-fe1d53f78ee2', 'aaadc7b5-68f6-47de-aec6-50f7f2e6d841', '0564e964-97c4-4b4c-825c-483ead178327', '22201481-d481-4bef-b8a3-126fcd9821a7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:38 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:16:38 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: deleting Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: deleting {{(pid=87265) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Deleting offline snapshot a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d of volume bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] snapshot_file for this snap is: volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9968387-236b-45be-a8fa-197fc1ffade1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:39 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:39 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:39 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.069s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:16:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ddbde0a6-c3e2-4c1a-a505-041bb5a14835 tempest-GroupSnapshotsTest-1696846439 None] Delete group completed successfully. Jul 09 09:16:40 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 1.066s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:16:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2032c-e3ce-44ab-953e-b46200ea0cda]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:40 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:40 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:41 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 0.980s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:41 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:41 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:42 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 1.075s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:42 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d Jul 09 09:16:42 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:43 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8.a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a9a2a6b0-3ea4-4903-a90d-6909f9e2a25d" released by "_delete_snapshot" :: held 4.172s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" released by "delete_snapshot" :: held 4.204s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:43 devstack cinder-volume[87265]: WARNING cinder.quota [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2144556144 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2144556144, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:16:43 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['404773c3-1f99-45d2-81b6-cf5ae77a8fdd', '6d9c4a2a-90fe-4de0-a547-c55eb34d11b0', '7383c3f8-dc03-4855-919e-1538edaaea77', 'dfce4ca7-74c1-459f-a726-819a28bcb69b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:16:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-adf6d246-7d99-445a-b4c7-7d0facc7b996 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 79c13392-d4a9-435a-bdd1-61a2d0bc4e36: deleted successfully Jul 09 09:16:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:16:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:16:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7506df-7941-4c5f-b5c8-4d2bb3feb83d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:44 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:44 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:45 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 1.093s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:45 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8 Jul 09 09:16:45 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:46 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" returned: 0 in 0.846s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-bbb9b690-4cc8-46ca-8b78-65c488ad81b8" released by "delete_volume" :: held 2.064s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['edf4a555-f208-4d45-8b86-d23c3ad3ae86'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:16:46 devstack cinder-volume[87265]: WARNING cinder.db.api [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2144556144'] Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['7d9919fc-39b7-448f-a1c6-baa29b475a56', '1130e5cd-024f-4524-ada6-c7c0efed7da8', 'b6d75644-b37c-4655-8e56-2fe5ac5f8ae9', 'bb291dc7-87a7-45d1-8c04-4905eb47289a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:46 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:16:46 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-be4ead09-caa2-4a2e-85ad-01bc3d409d11 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-392896640: creating Jul 09 09:16:48 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.775s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:48 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:16:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-03d9afc0-2764-4048-ba26-31cf6c3fcf70 tempest-GroupSnapshotsTest-1696846439 None] Delete group completed successfully. Jul 09 09:16:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-be4ead09-caa2-4a2e-85ad-01bc3d409d11 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-392896640: created successfully Jul 09 09:16:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-be4ead09-caa2-4a2e-85ad-01bc3d409d11 tempest-GroupSnapshotsTest-1696846439 None] Create group completed successfully. Jul 09 09:16:49 devstack cinder-volume[87265]: WARNING py.warnings [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 09 09:16:49 devstack cinder-volume[87265]: .first() Jul 09 09:16:49 devstack cinder-volume[87265]: Jul 09 09:16:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea382f-1ee3-417c-a960-a4240f0009c4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:16:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:49 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 Jul 09 09:16:49 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:16:50 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:16:50 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (e2509131-2a39-482e-89c5-24ed00c98491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb56cad7-06c1-4fb8-8931-ccb033535d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb56cad7-06c1-4fb8-8931-ccb033535d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038166934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,host='devstack@QuobyteHD#QuobyteHD',id=1f3921a7-b536-4caf-931c-2260c2c6c4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:50Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9148b8e-000b-4ec3-8c45-c177bf472ae9),volume_type_id=b9148b8e-000b-4ec3-8c45-c177bf472ae9)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354c1472-1c6d-4acc-bf8c-3db3ca977eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354c1472-1c6d-4acc-bf8c-3db3ca977eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a14b2a-c20e-42c5-a7d2-beaec2917e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a14b2a-c20e-42c5-a7d2-beaec2917e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3921a7-b536-4caf-931c-2260c2c6c4f7', 'volume_name': 'volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeea97f0-0dcc-48cc-80d5-2be68764a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeea97f0-0dcc-48cc-80d5-2be68764a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c9387-64c3-452a-bc36-2f4646604c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Volume 1f3921a7-b536-4caf-931c-2260c2c6c4f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7', 'volume_size': 1} Jul 09 09:16:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:51 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" returned: 0 in 1.593s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.621s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,created_at=2026-07-09T07:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038166934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,host='devstack@QuobyteHD#QuobyteHD',id=1f3921a7-b536-4caf-931c-2260c2c6c4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:50Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9148b8e-000b-4ec3-8c45-c177bf472ae9),volume_type_id=b9148b8e-000b-4ec3-8c45-c177bf472ae9)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Creating volume 1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:51 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:51 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 1073741824 Jul 09 09:16:51 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d14eda4-f6bc-4ea4-b0e5-3f4ea6bf5d7f', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.221s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:16:51 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 8 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:16:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:16:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-73ed715f-2649-4501-9916-2421feca24bb req-57dc9d56-b908-4edf-aa61-2f573425760f tempest-TaggedAttachmentsTest-801533008 None] attachment_update completed successfully. Jul 09 09:16:52 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 1073741824" returned: 0 in 1.708s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:53 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 Jul 09 09:16:53 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Flow 'volume_create_manager' (e3e259df-9d7c-488a-9c1a-3af6bc3b6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd58116-46ee-4513-9052-f4db20b297cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd58116-46ee-4513-9052-f4db20b297cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1957850658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709aec2f-eea2-4744-9591-3a0b9600ce03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fda70d1af34bb28da6af5ced655a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:53Z,use_quota=True,user_id='9c0c6fe462c44352908d7db9e40d1672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b4c97-2fd8-43ae-8566-c8522c3bf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b4c97-2fd8-43ae-8566-c8522c3bf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a13cf4-8d59-48f4-a339-4eacb3ca3503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a13cf4-8d59-48f4-a339-4eacb3ca3503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709aec2f-eea2-4744-9591-3a0b9600ce03', 'volume_name': 'volume-709aec2f-eea2-4744-9591-3a0b9600ce03', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99a2d72-db6f-400e-9c1b-0928a5817b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99a2d72-db6f-400e-9c1b-0928a5817b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d095bb-42dd-4f2b-9eee-7ff3fc931931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Volume 709aec2f-eea2-4744-9591-3a0b9600ce03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709aec2f-eea2-4744-9591-3a0b9600ce03', 'volume_size': 1} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:53 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] <== create_volume: return (2563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1957850658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709aec2f-eea2-4744-9591-3a0b9600ce03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fda70d1af34bb28da6af5ced655a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:53Z,use_quota=True,user_id='9c0c6fe462c44352908d7db9e40d1672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Creating volume 709aec2f-eea2-4744-9591-3a0b9600ce03 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:53 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c9387-64c3-452a-bc36-2f4646604c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 1073741824 Jul 09 09:16:53 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d3ae97-e8de-4b41-8690-8d0712742d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:53 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Volume volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 (1f3921a7-b536-4caf-931c-2260c2c6c4f7): created successfully Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d3ae97-e8de-4b41-8690-8d0712742d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (e2509131-2a39-482e-89c5-24ed00c98491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ac570a2a-696e-492c-a41f-22604f5b65fc tempest-GroupSnapshotsTest-1696846439 None] Created volume successfully. Jul 09 09:16:54 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 1073741824" returned: 0 in 0.996s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:54 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 Jul 09 09:16:54 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (a9182fe4-66e6-4294-a9a8-56124103572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d6c6d-3cee-4851-9250-80b111fb8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7d6c6d-3cee-4851-9250-80b111fb8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2013446286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,host='devstack@QuobyteHD#QuobyteHD',id=e989ce47-0232-487e-8480-475b80f6d5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:55Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9148b8e-000b-4ec3-8c45-c177bf472ae9),volume_type_id=b9148b8e-000b-4ec3-8c45-c177bf472ae9)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128f4289-53ec-4371-bcf4-379fea3c3e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128f4289-53ec-4371-bcf4-379fea3c3e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52895982-9e4d-4c69-929c-f8e5e2459250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52895982-9e4d-4c69-929c-f8e5e2459250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e989ce47-0232-487e-8480-475b80f6d5f2', 'volume_name': 'volume-e989ce47-0232-487e-8480-475b80f6d5f2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b8b64-7140-4f9c-aa0a-8efb1a19121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885b8b64-7140-4f9c-aa0a-8efb1a19121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba036c7-c70c-4559-b96e-d7a4bdef2a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Volume e989ce47-0232-487e-8480-475b80f6d5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e989ce47-0232-487e-8480-475b80f6d5f2', 'volume_size': 1} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:55 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03" returned: 0 in 0.897s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,created_at=2026-07-09T07:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2013446286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275d7d2-d125-4d85-acba-7e00ca13d9ff,host='devstack@QuobyteHD#QuobyteHD',id=e989ce47-0232-487e-8480-475b80f6d5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:55Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9148b8e-000b-4ec3-8c45-c177bf472ae9),volume_type_id=b9148b8e-000b-4ec3-8c45-c177bf472ae9)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Creating volume e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:16:55 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:55 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 1073741824 Jul 09 09:16:55 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d095bb-42dd-4f2b-9eee-7ff3fc931931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709aec2f-eea2-4744-9591-3a0b9600ce03', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ec3e23-9776-4cec-8c27-e422c3703468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Volume volume-709aec2f-eea2-4744-9591-3a0b9600ce03 (709aec2f-eea2-4744-9591-3a0b9600ce03): created successfully Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ec3e23-9776-4cec-8c27-e422c3703468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Flow 'volume_create_manager' (e3e259df-9d7c-488a-9c1a-3af6bc3b6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7078f54a-37a0-47d1-8a82-2bd90a5ff572 tempest-DeleteServersTestJSON-1584033099 None] Created volume successfully. Jul 09 09:16:56 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 1073741824" returned: 0 in 1.108s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:16:56 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 Jul 09 09:16:56 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:16:57 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba036c7-c70c-4559-b96e-d7a4bdef2a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e989ce47-0232-487e-8480-475b80f6d5f2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdd8ff1-7b4a-4847-a682-620f29512dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:16:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Volume volume-e989ce47-0232-487e-8480-475b80f6d5f2 (e989ce47-0232-487e-8480-475b80f6d5f2): created successfully Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdd8ff1-7b4a-4847-a682-620f29512dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:16:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (a9182fe4-66e6-4294-a9a8-56124103572f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:16:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e2b91862-b41f-4d42-b168-f17f5e6babb5 tempest-GroupSnapshotsTest-1696846439 None] Created volume successfully. Jul 09 09:16:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-432ccef3-f87f-4989-bf6d-0896997845dc req-eb0762f5-27f1-4921-ac44-d753db51e883 tempest-TaggedAttachmentsTest-801533008 None] Terminate volume connection completed successfully. Jul 09 09:16:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-432ccef3-f87f-4989-bf6d-0896997845dc req-eb0762f5-27f1-4921-ac44-d753db51e883 tempest-TaggedAttachmentsTest-801533008 None] Deleting attachment 2d14eda4-f6bc-4ea4-b0e5-3f4ea6bf5d7f. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:16:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-355e2027-ce45-42c9-b6c0-cb0380a49c5b tempest-GroupSnapshotsTest-1696846439 None] Update group completed successfully. Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3882e6-90ce-48de-b251-1aab48d0eec9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:00 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 Jul 09 09:17:00 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8bd00c98-dbf6-4985-99ee-b5cccf6e81ea tempest-GroupSnapshotsTest-1696846439 None] Update group completed successfully. Jul 09 09:17:00 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03" returned: 0 in 0.823s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-709aec2f-eea2-4744-9591-3a0b9600ce03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96d71382-9c43-46de-956d-5e3c63d3891d', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:17:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-14eae863-12c7-4579-b5dd-8e688221ceff req-755668ed-244d-4b03-9744-fb9cb4a2f7b0 tempest-DeleteServersTestJSON-1584033099 None] attachment_update completed successfully. Jul 09 09:17:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-81f228ff-59e5-471b-ae04-933b55cf1bb9 tempest-GroupSnapshotsTest-1696846439 None] Update group completed successfully. Jul 09 09:17:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a0b62347-e790-4c38-950a-05b99dd2f5f2 tempest-GroupSnapshotsTest-1696846439 None] Update group completed successfully. Jul 09 09:17:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] GroupSnapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: creating. Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Group snapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: creating. {{(pid=87265) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Creating offline snapshot 2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 of volume 1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[216aa06f-3bb2-4406-871c-3b9b1d9c47ca]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:04 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 Jul 09 09:17:04 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:05 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7" returned: 0 in 0.874s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:05 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 1G Jul 09 09:17:05 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:06 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 1G" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:06 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 Jul 09 09:17:06 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:07 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" returned: 0 in 0.729s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:07 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:07 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 Jul 09 09:17:07 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:07 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" returned: 0 in 0.769s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:08 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info Jul 09 09:17:08 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:08 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info" returned: 0 in 0.753s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:08 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:08 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info Jul 09 09:17:08 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:09 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.info" returned: 0 in 0.881s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.914s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Creating offline snapshot 5e4b6658-c861-4930-b928-095f9f652f70 of volume e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c9f49b-46bf-4c54-bb04-a7a25a246433]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-0c6fc6ff-8fe5-4329-ac00-cdcc9c6bad08 req-33dfd5c1-8519-4b19-a49a-2ceb17e6faf6 tempest-DeleteServersTestJSON-1584033099 None] Terminate volume connection completed successfully. Jul 09 09:17:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-0c6fc6ff-8fe5-4329-ac00-cdcc9c6bad08 req-33dfd5c1-8519-4b19-a49a-2ceb17e6faf6 tempest-DeleteServersTestJSON-1584033099 None] Deleting attachment 96d71382-9c43-46de-956d-5e3c63d3891d. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:17:09 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 Jul 09 09:17:09 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:10 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2" returned: 0 in 0.891s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:10 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 1G Jul 09 09:17:10 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:11 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 1G" returned: 0 in 0.892s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e989ce47-0232-487e-8480-475b80f6d5f2 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:11 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e989ce47-0232-487e-8480-475b80f6d5f2 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 Jul 09 09:17:11 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:12 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e989ce47-0232-487e-8480-475b80f6d5f2 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:12 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:12 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 Jul 09 09:17:12 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:12 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70" returned: 0 in 0.654s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:12 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info Jul 09 09:17:12 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "cinder-709aec2f-eea2-4744-9591-3a0b9600ce03-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "cinder-709aec2f-eea2-4744-9591-3a0b9600ce03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "cinder-quobyte-709aec2f-eea2-4744-9591-3a0b9600ce03" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "cinder-quobyte-709aec2f-eea2-4744-9591-3a0b9600ce03" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc5285-2b67-45b4-accc-57a38116a099]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:13 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 Jul 09 09:17:13 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:13 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info" returned: 0 in 0.687s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:13 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:13 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info Jul 09 09:17:13 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:14 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03" returned: 0 in 0.767s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:14 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03 Jul 09 09:17:14 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:14 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.info" returned: 0 in 0.703s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.655s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.857s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae9e58c-88f2-40a8-b51d-a89b9fac2212]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9bfda3d9-e991-4735-96d8-57f81485583f tempest-GroupSnapshotsTest-1696846439 None] group_snapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: created successfully Jul 09 09:17:14 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 Jul 09 09:17:14 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:14 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-709aec2f-eea2-4744-9591-3a0b9600ce03" returned: 0 in 0.682s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "cinder-quobyte-709aec2f-eea2-4744-9591-3a0b9600ce03" released by "delete_volume" :: held 1.498s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Created reservations ['bba77a23-e562-4d2d-bb11-787d39295138', '4b67a86e-6e9e-476a-8e71-2028ccb8d938', '89609a5a-acb4-46f8-a736-45825a84c000', '64eea917-f5d4-4f94-be50-7286460007bf'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:14 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:17:14 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:15 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855" returned: 0 in 0.801s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-eece3741-8692-4bed-9669-98b7abf31855', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37dc7e20-b9c7-4479-b994-dec0712433b6', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:17:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a4deddcf-c35e-4b31-bb89-5d1456701234 req-76ae6581-ee0d-427e-9335-c0d548f4dc11 tempest-ServerActionsTestOtherA-1344017989 None] attachment_update completed successfully. Jul 09 09:17:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: deleting Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: deleting {{(pid=87265) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Deleting offline snapshot 2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 of volume 1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] snapshot_file for this snap is: volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b6ff3-408e-4116-a4cf-228745a93c57]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:15 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 Jul 09 09:17:15 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:15 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.985s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:15 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:17:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Deleted volume successfully. Jul 09 09:17:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bc11209-4e63-45d3-9813-7b9ebc587d88 tempest-DeleteServersTestJSON-1584033099 None] Lock "cinder-709aec2f-eea2-4744-9591-3a0b9600ce03-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:16 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" returned: 0 in 1.064s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:17:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f15d94-a169-4dae-ab83-4e24f36972c7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:16 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 Jul 09 09:17:16 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "cinder-1eeeb84a-75d5-43b2-b72b-aab7169e71e1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "cinder-1eeeb84a-75d5-43b2-b72b-aab7169e71e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "cinder-quobyte-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "cinder-quobyte-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b50cc9-e8bb-4b98-89ea-8ed97ffa0bf0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:17 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 Jul 09 09:17:17 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:17 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7" returned: 0 in 0.986s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:17 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 Jul 09 09:17:17 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:18 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" returned: 0 in 0.928s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:18 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1 Jul 09 09:17:18 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:18 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" returned: 0 in 0.921s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:18 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907 Jul 09 09:17:18 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:19 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" returned: 0 in 0.909s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "cinder-quobyte-1eeeb84a-75d5-43b2-b72b-aab7169e71e1" released by "delete_volume" :: held 1.915s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Created reservations ['0cb8329e-1a89-4b0e-808f-b0f51264d6da', 'ecce9770-bdda-448c-a07b-65f22473c528', '409e7c7c-078f-4feb-9599-3af6e7d1070c', 'fb811982-e894-4c20-bea1-bd4f39894c32'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:19 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7.2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-2d4bf1e0-cf03-4b69-a6b0-0b6dda4e9907" released by "_delete_snapshot" :: held 4.053s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" released by "delete_snapshot" :: held 4.105s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:19 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:17:19 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-5e4b6658-c861-4930-b928-095f9f652f70" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5e4b6658-c861-4930-b928-095f9f652f70" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Deleting offline snapshot 5e4b6658-c861-4930-b928-095f9f652f70 of volume e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] snapshot_file for this snap is: volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[16539756-4c00-4fc0-bca7-cd042d3643b0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:20 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 Jul 09 09:17:20 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:20 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.984s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:20 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:17:20 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Deleted volume successfully. Jul 09 09:17:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d41b9e55-5f17-4041-9788-ccc5f94e39e7 tempest-TaggedAttachmentsTest-801533008 None] Lock "cinder-1eeeb84a-75d5-43b2-b72b-aab7169e71e1-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:21 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70" returned: 0 in 1.234s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e989ce47-0232-487e-8480-475b80f6d5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:17:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[729df877-d3dd-4ec5-8fdc-bf0f034fa676]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:21 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 Jul 09 09:17:21 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:22 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2" returned: 0 in 1.013s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:22 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 Jul 09 09:17:22 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:23 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:23 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70 Jul 09 09:17:23 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-90f3369f-d395-4e1d-bf88-1d0f35ad3ab9 tempest-ServerActionsTestOtherA-1344017989 None] Terminate volume connection completed successfully. Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-90f3369f-d395-4e1d-bf88-1d0f35ad3ab9 tempest-ServerActionsTestOtherA-1344017989 None] Deleting attachment 37dc7e20-b9c7-4479-b994-dec0712433b6. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:17:24 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2.5e4b6658-c861-4930-b928-095f9f652f70" returned: 0 in 0.998s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-5e4b6658-c861-4930-b928-095f9f652f70" released by "_delete_snapshot" :: held 4.250s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" released by "delete_snapshot" :: held 4.296s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:24 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-83318276 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-83318276, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:24 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-83318276 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-83318276, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['60f193b8-7f86-4f9d-84b4-858e970a3327', '3dd42a9f-5352-4771-a32e-924a68536c3c', '494a394e-fb55-4121-8706-1502d4c7c39f', '42b695f7-ae9c-4e25-a931-8ab3fd655e50'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['ff67869d-0469-4296-b423-cbf3eefaed9d', '223d5d71-a912-47e6-abd4-86b2afc1a69f', 'ce7ac077-b665-4898-9b27-859c1bb2417a', '5bb9d75c-563d-4baf-a766-5923dee40b06'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ab376092-0390-4904-a9d0-e496e4afe024 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot b75cef4c-dc51-4f68-b7d6-575a30fcb2ef: deleted successfully Jul 09 09:17:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7370a72-bb9e-49aa-9f0b-df51f0fba96d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:25 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 Jul 09 09:17:25 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:26 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7" returned: 0 in 1.166s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:26 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7 Jul 09 09:17:26 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[314527bf-e33e-4fa6-906f-6120b9d03b39]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:27 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 Jul 09 09:17:27 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:27 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1f3921a7-b536-4caf-931c-2260c2c6c4f7" returned: 0 in 0.970s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-1f3921a7-b536-4caf-931c-2260c2c6c4f7" released by "delete_volume" :: held 2.241s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" acquired by "delete_volume" :: waited 0.040s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589273f-e77f-4648-899b-f8e964f6d0c6]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:27 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 Jul 09 09:17:27 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:27 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855" returned: 0 in 1.054s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.087s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-eece3741-8692-4bed-9669-98b7abf31855', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a32e32da-13a8-4695-b26a-947ec6c9817a', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:17:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-7c95953c-a873-48e3-acd6-ef65eb74dc17 req-4eb535ab-4738-4d5a-8894-ab630abcd826 tempest-ServerActionsTestOtherA-1344017989 None] attachment_update completed successfully. Jul 09 09:17:28 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2" returned: 0 in 1.151s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:28 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2 Jul 09 09:17:28 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:29 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e989ce47-0232-487e-8480-475b80f6d5f2" returned: 0 in 0.780s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-e989ce47-0232-487e-8480-475b80f6d5f2" released by "delete_volume" :: held 2.006s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['18b802aa-a904-402e-8d4d-0f3f28a03064'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:29 devstack cinder-volume[87265]: WARNING cinder.quota [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-83318276 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-83318276, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['23bc8cdb-ab7f-4247-9da4-5a49353beb0e', '502563f1-fd30-42fd-826f-52ac3ff6319f', '728e13c2-6351-4dfa-9a0b-3c93518cd972', 'f1a67991-0797-414a-a1d6-07784c333737'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['24a18873-c852-4e26-9e05-110dad28db9e', '2dd89b0c-7f8a-45e0-8015-0822e114f05a', 'cadfddf1-d589-4700-8145-c09f9f9e3ce8', 'e5e9f399-9f25-454d-9fb1-81870e107544'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:29 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:17:29 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:30 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:17:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9f4e3932-09b1-40a0-ae5d-f437b5cc165c tempest-GroupSnapshotsTest-1696846439 None] Delete group completed successfully. Jul 09 09:17:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-671e93c0-0909-41e4-bfb2-a19717d8bcf8 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-1981342949: creating Jul 09 09:17:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-671e93c0-0909-41e4-bfb2-a19717d8bcf8 tempest-GroupSnapshotsTest-1696846439 None] Group tempest-GroupSnapshotsTest-Group-1981342949: created successfully Jul 09 09:17:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-671e93c0-0909-41e4-bfb2-a19717d8bcf8 tempest-GroupSnapshotsTest-1696846439 None] Create group completed successfully. Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (3dc1b5a1-c4fb-4691-9002-984fb51078f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9925d70-2080-40df-9293-7362aa015c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9925d70-2080-40df-9293-7362aa015c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843465916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d8a328e-039e-4e93-b1a4-7fb652dcdfca,host='devstack@QuobyteHD#QuobyteHD',id=a2ab6149-16c4-4056-b2b2-fda476f3a30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:33Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9666eb5-4b2b-4240-a914-a2407d5a3aff),volume_type_id=d9666eb5-4b2b-4240-a914-a2407d5a3aff)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef62d42-a9d6-46a2-95b2-5bb606f2ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef62d42-a9d6-46a2-95b2-5bb606f2ee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02e6676-7a55-4764-a524-981b27f9cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02e6676-7a55-4764-a524-981b27f9cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ab6149-16c4-4056-b2b2-fda476f3a30d', 'volume_name': 'volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d90673-5c50-4629-876b-d50bfbd0333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d90673-5c50-4629-876b-d50bfbd0333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a598ed6b-97f1-4ebc-bb82-37ca60ce3071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Volume a2ab6149-16c4-4056-b2b2-fda476f3a30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d', 'volume_size': 1} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d8a328e-039e-4e93-b1a4-7fb652dcdfca,created_at=2026-07-09T07:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843465916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d8a328e-039e-4e93-b1a4-7fb652dcdfca,host='devstack@QuobyteHD#QuobyteHD',id=a2ab6149-16c4-4056-b2b2-fda476f3a30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c422af38e9470cadc4aeefcf9c5d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:33Z,use_quota=True,user_id='98701facb821408ca1159e6e4bfcb30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9666eb5-4b2b-4240-a914-a2407d5a3aff),volume_type_id=d9666eb5-4b2b-4240-a914-a2407d5a3aff)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Creating volume a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:17:33 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:17:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:33 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d 1073741824 Jul 09 09:17:33 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:34 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d 1073741824" returned: 0 in 1.206s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:34 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d Jul 09 09:17:34 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:35 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d" returned: 0 in 1.079s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.390s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=106,cinder:SELECT=99,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a598ed6b-97f1-4ebc-bb82-37ca60ce3071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ddc3a-592d-4bf5-97a7-f7c55c15829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=99,cinder:SELECT=126,cinder:INSERT=25 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:17:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Volume volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d (a2ab6149-16c4-4056-b2b2-fda476f3a30d): created successfully Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ddc3a-592d-4bf5-97a7-f7c55c15829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:17:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Flow 'volume_create_manager' (3dc1b5a1-c4fb-4691-9002-984fb51078f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:17:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a43ecf5c-ce52-4eed-8942-1cb50c20f1e5 tempest-GroupSnapshotsTest-1696846439 None] Created volume successfully. Jul 09 09:17:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] GroupSnapshot 5109b946-d23f-452a-b0d4-430f21e1534b: creating. Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Group snapshot 5109b946-d23f-452a-b0d4-430f21e1534b: creating. {{(pid=87265) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Creating offline snapshot 31ca50d1-b6e2-41ca-9468-6d4637c639a1 of volume a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[24889eb1-f8f7-43f1-8cc9-900fed92c6a4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:37 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d Jul 09 09:17:37 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:38 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d" returned: 0 in 1.383s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:38 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 1G Jul 09 09:17:39 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:39 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 1G" returned: 0 in 0.904s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:39 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 Jul 09 09:17:39 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:40 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1" returned: 0 in 0.833s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:40 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:40 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 Jul 09 09:17:40 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:41 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1" returned: 0 in 0.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:41 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info Jul 09 09:17:41 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:42 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info" returned: 0 in 0.731s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:42 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:17:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:42 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info Jul 09 09:17:42 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:43 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.info" returned: 0 in 0.950s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.747s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-00f63a65-52c3-4560-9120-1628be0b2edf tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 5109b946-d23f-452a-b0d4-430f21e1534b: created successfully Jul 09 09:17:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 5109b946-d23f-452a-b0d4-430f21e1534b: deleting Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 5109b946-d23f-452a-b0d4-430f21e1534b: deleting {{(pid=87265) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-31ca50d1-b6e2-41ca-9468-6d4637c639a1" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-31ca50d1-b6e2-41ca-9468-6d4637c639a1" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Deleting offline snapshot 31ca50d1-b6e2-41ca-9468-6d4637c639a1 of volume a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] snapshot_file for this snap is: volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c31373-7a01-491d-9231-7ea2242c81b3]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:44 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 Jul 09 09:17:44 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:45 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1" returned: 0 in 1.476s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:17:45 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431d37d-abd6-48cc-9ad8-062f648aac94]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:46 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d Jul 09 09:17:46 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:47 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d" returned: 0 in 1.242s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:47 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 Jul 09 09:17:47 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:48 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1" returned: 0 in 1.079s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:48 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1 Jul 09 09:17:48 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:49 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d.31ca50d1-b6e2-41ca-9468-6d4637c639a1" returned: 0 in 0.884s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-31ca50d1-b6e2-41ca-9468-6d4637c639a1" released by "_delete_snapshot" :: held 4.860s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" released by "delete_snapshot" :: held 4.926s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:49 devstack cinder-volume[87265]: WARNING cinder.quota [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-524012023 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-524012023, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:49 devstack cinder-volume[87265]: WARNING cinder.quota [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-524012023 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-524012023, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['b111558d-3d17-4e27-96e8-410670062c7c', 'bc0aa239-0dd8-4319-b166-0e64c6b3ac60', 'c93c21f0-5b87-4cf9-bbb6-833654c19180', 'df58df37-c3b9-43ea-9b0b-92cf660b1c1b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1c38287c-c24d-4c02-8c29-414ba6c79ee6 tempest-GroupSnapshotsTest-1696846439 None] group_snapshot 5109b946-d23f-452a-b0d4-430f21e1534b: deleted successfully Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a11a142-d4db-4278-afed-a35fcd4e76e3]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:50 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:17:50 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:50 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d Jul 09 09:17:50 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:51 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d" returned: 0 in 1.037s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:51 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d Jul 09 09:17:51 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:51 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.989s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 8 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:17:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:17:52 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a2ab6149-16c4-4056-b2b2-fda476f3a30d" returned: 0 in 0.751s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Lock "cinder-quobyte-a2ab6149-16c4-4056-b2b2-fda476f3a30d" released by "delete_volume" :: held 1.880s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['10b6b5ea-b3b2-495d-be2e-1987d465fac8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:52 devstack cinder-volume[87265]: WARNING cinder.quota [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-524012023 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-524012023, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Created reservations ['2646b4a6-45b8-4fb2-989f-e495a300d4db', '9bbfd64b-8dc3-4c26-91a0-bcf2bc42673d', '39d9ca9e-847d-4a21-9e12-76c7e0696a97', 'bce3707f-abdb-4747-9091-727e53a6d9e9'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:17:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:17:52 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:17:52 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:17:53 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 09 09:17:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.753s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:17:53 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:17:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1912f3da-89cb-4f05-986b-b9a20f111abd tempest-GroupSnapshotsTest-1696846439 None] Delete group completed successfully. Jul 09 09:18:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a92d90d0-1de1-4b5d-9563-5b9c24775a8f req-0e5e2e66-f126-4e1b-ac39-7e9e872f399a tempest-ServerActionsTestOtherA-1344017989 None] Terminate volume connection completed successfully. Jul 09 09:18:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a92d90d0-1de1-4b5d-9563-5b9c24775a8f req-0e5e2e66-f126-4e1b-ac39-7e9e872f399a tempest-ServerActionsTestOtherA-1344017989 None] Deleting attachment a32e32da-13a8-4695-b26a-947ec6c9817a. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:18:11 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=24,cinder:DELETE=1,cinder:SELECT=25,cinder:INSERT=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:18:11 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=15 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:18:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "cinder-eece3741-8692-4bed-9669-98b7abf31855-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "cinder-eece3741-8692-4bed-9669-98b7abf31855-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "cinder-quobyte-eece3741-8692-4bed-9669-98b7abf31855" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "cinder-quobyte-eece3741-8692-4bed-9669-98b7abf31855" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f35f1b-d0d7-49d9-9a02-1c2f7aac861a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:15 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 Jul 09 09:18:15 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:16 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855" returned: 0 in 1.246s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:16 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855 Jul 09 09:18:16 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:17 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-eece3741-8692-4bed-9669-98b7abf31855" returned: 0 in 1.009s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "cinder-quobyte-eece3741-8692-4bed-9669-98b7abf31855" released by "delete_volume" :: held 2.351s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Created reservations ['47083eeb-2efb-4868-98e7-209f2e92246e', 'a7a933b4-df92-45ca-af5a-6c5867c6835d', 'c8e01151-fdcd-4319-9953-00547c227b8f', '9ff36a57-1fee-4ba0-a64d-4700bedde382'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:17 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:18:17 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:19 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.516s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:19 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:18:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Deleted volume successfully. Jul 09 09:18:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac0d936a-cfa9-42be-9a21-37956f6c8569 tempest-ServerActionsTestOtherA-1344017989 None] Lock "cinder-eece3741-8692-4bed-9669-98b7abf31855-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Flow 'volume_create_manager' (7c1c60c5-4ab8-479d-af3a-8f748ddf9f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b711b9e-122a-4f6a-8f7b-587ce47844ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b711b9e-122a-4f6a-8f7b-587ce47844ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2146214990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75fa180-6c48-4e6d-846d-156596ddcb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6be3bdb6c148ef925fff986f0d8291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:21Z,use_quota=True,user_id='7e92e77e81fe41f2bfc9a0b854bc4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805c433-87a8-4f08-807d-7d2203e04ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805c433-87a8-4f08-807d-7d2203e04ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e4cf06-5a34-4c16-b22a-a8e1cd039de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e4cf06-5a34-4c16-b22a-a8e1cd039de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75fa180-6c48-4e6d-846d-156596ddcb36', 'volume_name': 'volume-b75fa180-6c48-4e6d-846d-156596ddcb36', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1e8460-c1dc-44cb-9847-70a3f693eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1e8460-c1dc-44cb-9847-70a3f693eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9a2ccc-5f54-467f-a0c8-14093bb8c7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Volume b75fa180-6c48-4e6d-846d-156596ddcb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75fa180-6c48-4e6d-846d-156596ddcb36', 'volume_size': 1} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2146214990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75fa180-6c48-4e6d-846d-156596ddcb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6be3bdb6c148ef925fff986f0d8291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:21Z,use_quota=True,user_id='7e92e77e81fe41f2bfc9a0b854bc4ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Creating volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:18:21 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:18:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:21 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 1073741824 Jul 09 09:18:21 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:23 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 1073741824" returned: 0 in 1.708s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:23 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 Jul 09 09:18:23 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:24 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36" returned: 0 in 0.814s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] <== create_volume: return (2638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9a2ccc-5f54-467f-a0c8-14093bb8c7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75fa180-6c48-4e6d-846d-156596ddcb36', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4e80a-70de-4cb1-afbc-b11f2c5414cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Volume volume-b75fa180-6c48-4e6d-846d-156596ddcb36 (b75fa180-6c48-4e6d-846d-156596ddcb36): created successfully Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4e80a-70de-4cb1-afbc-b11f2c5414cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Flow 'volume_create_manager' (7c1c60c5-4ab8-479d-af3a-8f748ddf9f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6131cb84-c98e-40e3-b904-4235bab33b99 tempest-SnapshotsActionsTest-1683432630 None] Created volume successfully. Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Creating offline snapshot db9e05d1-290d-4f5b-86bf-e668747bf6b1 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f913c5-4136-426e-844e-49a92ace561e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:24 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 Jul 09 09:18:24 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:25 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36" returned: 0 in 0.893s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:25 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 1G Jul 09 09:18:25 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:26 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 1G" returned: 0 in 0.915s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:26 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:26 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:27 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.720s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:27 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 is being set with open permissions: ugo+rw Jul 09 09:18:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:27 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:27 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:27 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.660s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:27 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info Jul 09 09:18:27 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:28 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info" returned: 0 in 0.742s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:28 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info is being set with open permissions: ugo+rw Jul 09 09:18:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:28 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info Jul 09 09:18:28 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:29 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.info" returned: 0 in 0.753s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-54a67ded-af71-452c-93a8-51c9b738a527 tempest-SnapshotsActionsTest-1683432630 None] Create snapshot completed successfully Jul 09 09:18:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Creating offline snapshot 570031c8-3296-4c0f-ad9c-4d718e3df929 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:18:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0964793b-62d7-4e40-8fbd-a35d1c3c246d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:30 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:30 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:31 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.814s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:31 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 1G Jul 09 09:18:31 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Flow 'volume_create_manager' (a7ef546f-1a1a-4c11-9e49-ec4bcc5b366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e2aee8-3850-4dfe-a391-3fb2beecaf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e2aee8-3850-4dfe-a391-3fb2beecaf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-198914624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80f014d-5ee4-485e-aeaa-6d0d3205ae02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20b1c2011344552807d9c256262bfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:32Z,use_quota=True,user_id='eaa5a912c20141b2891398293ce54b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc7952d-cdd6-4652-8cfd-66f4e66b68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc7952d-cdd6-4652-8cfd-66f4e66b68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f518b17-52b3-4c90-a915-efd7bd7694d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f518b17-52b3-4c90-a915-efd7bd7694d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80f014d-5ee4-485e-aeaa-6d0d3205ae02', 'volume_name': 'volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b389cb-219d-4cd4-93d8-3f863791a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b389cb-219d-4cd4-93d8-3f863791a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc925250-3553-4cc3-8c5b-35f6a2885d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:32 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Volume d80f014d-5ee4-485e-aeaa-6d0d3205ae02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02', 'volume_size': 1} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:32 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 1G" returned: 0 in 1.049s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:32 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 Jul 09 09:18:32 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:33 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929" returned: 0 in 0.762s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:33 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 is being set with open permissions: ugo+rw Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:33 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 Jul 09 09:18:33 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:33 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-198914624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80f014d-5ee4-485e-aeaa-6d0d3205ae02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20b1c2011344552807d9c256262bfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:32Z,use_quota=True,user_id='eaa5a912c20141b2891398293ce54b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Creating volume d80f014d-5ee4-485e-aeaa-6d0d3205ae02 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:18:33 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:18:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:33 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 1073741824 Jul 09 09:18:33 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-36cda5c9-d2a9-4e5d-91a4-6c992ba1f14d tempest-SnapshotsActionsTest-1683432630 None] Create snapshot completed successfully Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (08a69e6c-7cfb-49b0-b3e1-028a02c50b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607af8c4-3e4f-4707-8275-294b9161a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607af8c4-3e4f-4707-8275-294b9161a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-657135448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c69ada3-a267-4ea8-bf2b-a27c6abf4737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:35Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bc3262-fabd-4425-a279-c53eaa25bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bc3262-fabd-4425-a279-c53eaa25bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64028ee-7397-4553-aa79-dbf72f2a2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64028ee-7397-4553-aa79-dbf72f2a2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c69ada3-a267-4ea8-bf2b-a27c6abf4737', 'volume_name': 'volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4526d4d-a83d-432e-adc6-553d05b55b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4526d4d-a83d-432e-adc6-553d05b55b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026c0d20-19fe-4095-aeff-8cf45f7d6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:34 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Volume 3c69ada3-a267-4ea8-bf2b-a27c6abf4737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737', 'volume_size': 1} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-570031c8-3296-4c0f-ad9c-4d718e3df929-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-570031c8-3296-4c0f-ad9c-4d718e3df929-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:34 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 1073741824" returned: 0 in 1.043s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-570031c8-3296-4c0f-ad9c-4d718e3df929" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-570031c8-3296-4c0f-ad9c-4d718e3df929" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Deleting offline snapshot 570031c8-3296-4c0f-ad9c-4d718e3df929 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] snapshot_file for this snap is: volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[950756ed-b8d7-4a4e-9b04-0df17627da47]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:34 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 Jul 09 09:18:34 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:35 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 Jul 09 09:18:35 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:35 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-657135448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c69ada3-a267-4ea8-bf2b-a27c6abf4737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:35Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Creating volume 3c69ada3-a267-4ea8-bf2b-a27c6abf4737 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:18:35 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:35 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 1073741824 Jul 09 09:18:35 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc925250-3553-4cc3-8c5b-35f6a2885d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3a136-e330-4c29-8e4f-84456335b45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Volume volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 (d80f014d-5ee4-485e-aeaa-6d0d3205ae02): created successfully Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3a136-e330-4c29-8e4f-84456335b45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Flow 'volume_create_manager' (a7ef546f-1a1a-4c11-9e49-ec4bcc5b366b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d3b53ae6-d4b2-4139-be97-58a5b2146141 tempest-ServersNegativeTestJSON-1642189695 None] Created volume successfully. Jul 09 09:18:35 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929" returned: 0 in 0.856s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da8a3a-d439-4518-adb6-3607aada9334]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:36 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:36 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:36 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 1073741824" returned: 0 in 1.023s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:36 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 Jul 09 09:18:36 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:36 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.997s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:36 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 Jul 09 09:18:36 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:37 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" returned: 0 in 0.835s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026c0d20-19fe-4095-aeff-8cf45f7d6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcde79b-a4a1-408b-bc62-911877825227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Volume volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 (3c69ada3-a267-4ea8-bf2b-a27c6abf4737): created successfully Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcde79b-a4a1-408b-bc62-911877825227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (08a69e6c-7cfb-49b0-b3e1-028a02c50b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fa4c7827-f346-4008-8676-eda868e2258d tempest-AttachVolumeTestJSON-1898156594 None] Created volume successfully. Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Flow 'volume_create_manager' (7b24bafe-1cfc-4b15-b6a2-f0ba9abe31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:37 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a244865-d4e6-44c5-a7b1-c6d96830bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929" returned: 0 in 1.075s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a244865-d4e6-44c5-a7b1-c6d96830bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1956996170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4e9e8-ea18-4e49-bee9-f72345729263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20b1c2011344552807d9c256262bfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:38Z,use_quota=True,user_id='eaa5a912c20141b2891398293ce54b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26b793-0054-4acd-a546-9c1d5d78b787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26b793-0054-4acd-a546-9c1d5d78b787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fdcd61-cb30-4d8a-b749-491e09511513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fdcd61-cb30-4d8a-b749-491e09511513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a4e9e8-ea18-4e49-bee9-f72345729263', 'volume_name': 'volume-c7a4e9e8-ea18-4e49-bee9-f72345729263', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:38 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929 Jul 09 09:18:38 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c121f674-9cb2-41da-ab18-e71b68bb64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c121f674-9cb2-41da-ab18-e71b68bb64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22983b0-1e67-4d3e-a61d-092abf52b960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Volume c7a4e9e8-ea18-4e49-bee9-f72345729263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a4e9e8-ea18-4e49-bee9-f72345729263', 'volume_size': 1} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1956996170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4e9e8-ea18-4e49-bee9-f72345729263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20b1c2011344552807d9c256262bfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:38Z,use_quota=True,user_id='eaa5a912c20141b2891398293ce54b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Creating volume c7a4e9e8-ea18-4e49-bee9-f72345729263 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:18:38 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:38 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 1073741824 Jul 09 09:18:38 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:38 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.570031c8-3296-4c0f-ad9c-4d718e3df929" returned: 0 in 0.807s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-570031c8-3296-4c0f-ad9c-4d718e3df929" released by "_delete_snapshot" :: held 3.907s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_snapshot" :: held 3.936s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:38 devstack cinder-volume[87265]: WARNING cinder.quota [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Created reservations ['d0f32d4f-4fec-4e90-b219-b15483e9ae87', 'b648fee8-f628-4f45-be27-5070dfa69237', '5adb5740-40a5-46df-adbf-5a1c96c80bf7', '6e346538-45a0-43a3-839c-a8224c66de33'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Delete snapshot completed successfully. Jul 09 09:18:38 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-903c7994-e88a-477e-8731-2e45ae47deb7 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-570031c8-3296-4c0f-ad9c-4d718e3df929-delete_snapshot" released by "delete_snapshot" :: held 4.113s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 1073741824" returned: 0 in 0.932s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:39 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 Jul 09 09:18:39 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:39 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263" returned: 0 in 0.814s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Creating offline snapshot 06c527de-35c6-42a8-9161-75d42ec150a3 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22983b0-1e67-4d3e-a61d-092abf52b960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a4e9e8-ea18-4e49-bee9-f72345729263', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f1048a-fbcc-4a23-871f-db6f99a78877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b51028-d83d-4322-a1cc-1ee480c6f97c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Volume volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 (c7a4e9e8-ea18-4e49-bee9-f72345729263): created successfully Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f1048a-fbcc-4a23-871f-db6f99a78877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:18:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Flow 'volume_create_manager' (7b24bafe-1cfc-4b15-b6a2-f0ba9abe31ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:18:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ba621aa6-7293-4711-9e22-af09e2d4f37f tempest-ServersNegativeTestJSON-1642189695 None] Created volume successfully. Jul 09 09:18:40 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:40 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:40 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.823s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:40 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 1G Jul 09 09:18:40 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "cinder-c7a4e9e8-ea18-4e49-bee9-f72345729263-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-c7a4e9e8-ea18-4e49-bee9-f72345729263-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "cinder-quobyte-c7a4e9e8-ea18-4e49-bee9-f72345729263" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-quobyte-c7a4e9e8-ea18-4e49-bee9-f72345729263" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[908514c0-62d9-45cc-8d8b-cb9b41844a0e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:41 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 Jul 09 09:18:41 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:41 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 1G" returned: 0 in 1.024s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:41 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 Jul 09 09:18:41 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:42 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3" returned: 0 in 0.971s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:42 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 is being set with open permissions: ugo+rw Jul 09 09:18:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:42 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 Jul 09 09:18:42 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:42 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263" returned: 0 in 1.243s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:42 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263 Jul 09 09:18:42 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:43 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3" returned: 0 in 0.706s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.712s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.380s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1c0b8-0048-4e71-9adb-56e6fc4dbb00]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2867b96c-ebe5-4bdf-901d-34c2e68a4256 tempest-SnapshotsActionsTest-1683432630 None] Create snapshot completed successfully Jul 09 09:18:43 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c7a4e9e8-ea18-4e49-bee9-f72345729263" returned: 0 in 0.780s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-quobyte-c7a4e9e8-ea18-4e49-bee9-f72345729263" released by "delete_volume" :: held 2.084s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:43 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 Jul 09 09:18:43 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Created reservations ['9130d1d8-6f35-4991-a420-6beaa7d1574c', '0308d08c-08d1-4024-b773-aa8f426ab78f', 'e0febb7c-51c8-48a1-a223-093b658a09dd', '265110c4-31d3-431f-908e-c7cadad533ca'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:43 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:18:43 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-06c527de-35c6-42a8-9161-75d42ec150a3-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-06c527de-35c6-42a8-9161-75d42ec150a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-06c527de-35c6-42a8-9161-75d42ec150a3" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-06c527de-35c6-42a8-9161-75d42ec150a3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Deleting offline snapshot 06c527de-35c6-42a8-9161-75d42ec150a3 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:18:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] snapshot_file for this snap is: volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d0014-71f9-4c81-9135-b619fdd514e7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:44 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 Jul 09 09:18:44 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:44 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.830s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:18:44 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Deleted volume successfully. Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" returned: 0 in 1.133s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9790b140-7569-47e2-ad48-74addb9aab8e tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-c7a4e9e8-ea18-4e49-bee9-f72345729263-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aac5bfc6-fc63-4262-a113-9373435804fa', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:18:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-09f207bc-cbf6-4585-bb50-c6e0d851ef38 req-e5ec2d70-567f-4e2d-b3fb-e9687ae6d6c7 tempest-AttachVolumeTestJSON-1898156594 None] attachment_update completed successfully. Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "cinder-d80f014d-5ee4-485e-aeaa-6d0d3205ae02-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-d80f014d-5ee4-485e-aeaa-6d0d3205ae02-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "cinder-quobyte-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-quobyte-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" acquired by "delete_volume" :: waited 0.036s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c754ba-db9f-4cea-80f2-74a6b665d437]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:45 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3" returned: 0 in 1.176s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b855f335-de52-44b4-95c2-bb87d481d240]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:45 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 Jul 09 09:18:45 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:45 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:45 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:46 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" returned: 0 in 0.951s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:46 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02 Jul 09 09:18:46 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:46 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.990s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:46 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 Jul 09 09:18:46 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:46 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" returned: 0 in 0.852s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-quobyte-d80f014d-5ee4-485e-aeaa-6d0d3205ae02" released by "delete_volume" :: held 1.867s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Created reservations ['5fc464a0-99a9-46b0-988a-39e18edaaa22', '7cc0e3f4-211e-41c3-a0d9-8438699edfb3', '1720beb7-c71a-4568-b384-34e6f1893afc', '49ece107-760c-4ac4-964b-2fdc510e5a1f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:47 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:18:47 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:47 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3" returned: 0 in 1.000s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:47 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3 Jul 09 09:18:47 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:48 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.012s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:18:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Deleted volume successfully. Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e7978e43-13b9-4cc6-9a1c-bbced11a39d3 tempest-ServersNegativeTestJSON-1642189695 None] Lock "cinder-d80f014d-5ee4-485e-aeaa-6d0d3205ae02-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:48 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.06c527de-35c6-42a8-9161-75d42ec150a3" returned: 0 in 0.909s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-06c527de-35c6-42a8-9161-75d42ec150a3" released by "_delete_snapshot" :: held 4.286s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_snapshot" :: held 4.317s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Created reservations ['a4df34a9-d6e8-4a36-b547-1b95be0a2a49', 'acc0e507-5b19-4944-a42f-8b1bba0916cc', 'f9986676-dc2b-47de-8fc8-8418c347a2c1', 'c68a37c6-46d5-44ff-93fd-96dbdd4c5fdc'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Delete snapshot completed successfully. Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6992a110-406c-4f42-b418-681802d3aef0 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-06c527de-35c6-42a8-9161-75d42ec150a3-delete_snapshot" released by "delete_snapshot" :: held 4.471s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Creating offline snapshot 9310bc92-6ff8-4625-a1b2-a5c5e839a036 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f7ffa-91c2-4803-9d4e-22380fab5d34]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:49 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:49 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:49 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.054s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:49 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 1G Jul 09 09:18:49 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:50 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:18:50 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:51 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 1G" returned: 0 in 1.208s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:51 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 Jul 09 09:18:51 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:51 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.831s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:18:52 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036" returned: 0 in 0.922s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:52 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 is being set with open permissions: ugo+rw Jul 09 09:18:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:52 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 Jul 09 09:18:52 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:52 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036" returned: 0 in 0.687s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.988s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:18:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d2219ce8-50eb-4b6f-8a71-dd771fb7d227 tempest-SnapshotsActionsTest-1683432630 None] Create snapshot completed successfully Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-9310bc92-6ff8-4625-a1b2-a5c5e839a036-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-9310bc92-6ff8-4625-a1b2-a5c5e839a036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-9310bc92-6ff8-4625-a1b2-a5c5e839a036" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-9310bc92-6ff8-4625-a1b2-a5c5e839a036" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Deleting offline snapshot 9310bc92-6ff8-4625-a1b2-a5c5e839a036 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] snapshot_file for this snap is: volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2557f197-c8c9-4eb5-a103-18cbe97da432]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:53 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 Jul 09 09:18:53 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:54 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036" returned: 0 in 1.008s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[061e850e-2c2c-44a7-a3d4-b6d69b568996]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:54 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:54 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:55 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 0.956s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:55 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 Jul 09 09:18:55 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:56 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036" returned: 0 in 0.961s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:56 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036 Jul 09 09:18:56 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:57 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.9310bc92-6ff8-4625-a1b2-a5c5e839a036" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-9310bc92-6ff8-4625-a1b2-a5c5e839a036" released by "_delete_snapshot" :: held 3.869s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_snapshot" :: held 3.895s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:57 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Created reservations ['49f5208c-57e3-4b23-b7a5-a1cfcdafe60e', 'fc0ce065-9eef-49e9-96da-a7ac2a69c14b', '33c72c2d-24a2-4b84-a6ef-e96fdc736783', 'd7b784c3-6f90-469b-a3c9-51459cde8501'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:18:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Delete snapshot completed successfully. Jul 09 09:18:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6ab80d24-b806-40f2-bc5f-8a83ef9618b3 tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-9310bc92-6ff8-4625-a1b2-a5c5e839a036-delete_snapshot" released by "delete_snapshot" :: held 4.075s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:18:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:18:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:18:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Creating offline snapshot f86e6da1-0f9b-4c96-a2c8-ca172681843e of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:18:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[62448702-c5b2-407a-908b-d54eca9a8caf]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:18:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:58 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:18:58 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:18:59 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 09 09:18:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.084s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:18:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:18:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:18:59 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e 1G Jul 09 09:18:59 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:00 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e 1G" returned: 0 in 1.291s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:00 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e Jul 09 09:19:00 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:01 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e" returned: 0 in 1.135s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:01 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e is being set with open permissions: ugo+rw Jul 09 09:19:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:01 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e Jul 09 09:19:01 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:03 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e" returned: 0 in 1.477s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.277s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fe229d5e-dc8e-43fb-a8a4-2e9f649c51ec tempest-SnapshotsActionsTest-1683432630 None] Create snapshot completed successfully Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-f86e6da1-0f9b-4c96-a2c8-ca172681843e-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-f86e6da1-0f9b-4c96-a2c8-ca172681843e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Acquiring lock "cinder-quobyte-f86e6da1-0f9b-4c96-a2c8-ca172681843e" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-f86e6da1-0f9b-4c96-a2c8-ca172681843e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Deleting offline snapshot f86e6da1-0f9b-4c96-a2c8-ca172681843e of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] snapshot_file for this snap is: volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a308961-865d-4ace-8ad2-b0627aa3708e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:05 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e Jul 09 09:19:05 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:07 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e" returned: 0 in 1.834s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:19:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c1b91-7186-42a2-b863-3e07eb320828]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:07 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:19:07 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:09 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.588s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:19:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:09 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e Jul 09 09:19:09 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:10 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e" returned: 0 in 1.740s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:10 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e Jul 09 09:19:10 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:12 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.f86e6da1-0f9b-4c96-a2c8-ca172681843e" returned: 0 in 1.257s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-f86e6da1-0f9b-4c96-a2c8-ca172681843e" released by "_delete_snapshot" :: held 6.626s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_snapshot" :: held 6.673s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=55,cinder:INSERT=13,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=59,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Created reservations ['a08ac301-4a45-4795-ae46-34a2306822fe', '57d12d6c-d9d0-4655-bf3b-43e8a73caeb0', '35259e8e-c0ff-4db2-bd7b-dcc3bb88c464', '0342ba26-da68-4f6a-9e85-234390ada485'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Delete snapshot completed successfully. Jul 09 09:19:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fd46c332-bcc8-4027-9e7d-b87f1812c1af tempest-SnapshotsActionsTest-268910806 None] Lock "cinder-f86e6da1-0f9b-4c96-a2c8-ca172681843e-delete_snapshot" released by "delete_snapshot" :: held 6.956s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "cinder-db9e05d1-290d-4f5b-86bf-e668747bf6b1-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-db9e05d1-290d-4f5b-86bf-e668747bf6b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "cinder-quobyte-db9e05d1-290d-4f5b-86bf-e668747bf6b1" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-db9e05d1-290d-4f5b-86bf-e668747bf6b1" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Deleting offline snapshot db9e05d1-290d-4f5b-86bf-e668747bf6b1 of volume b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] snapshot_file for this snap is: volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c03faa-5c2c-4605-9db4-b0638e983b40]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:14 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:19:14 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:15 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.466s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75fa180-6c48-4e6d-846d-156596ddcb36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:19:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0b9e2-cdec-4175-bf73-4d32ec1546a6]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:15 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 Jul 09 09:19:15 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:17 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36" returned: 0 in 1.699s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:17 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:19:17 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:18 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.331s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:18 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1 Jul 09 09:19:18 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:19 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36.db9e05d1-290d-4f5b-86bf-e668747bf6b1" returned: 0 in 1.058s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-db9e05d1-290d-4f5b-86bf-e668747bf6b1" released by "_delete_snapshot" :: held 5.705s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_snapshot" :: held 5.754s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:19 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Created reservations ['9403efb9-3311-4c07-8a0d-598233fa8fef', '39c20243-7167-42c4-aadc-003d8db591ef', '72dd6a04-efa8-4564-b8e2-e87e045d27b1', '22531525-b131-4dbf-af92-c2e03b9b2633'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Delete snapshot completed successfully. Jul 09 09:19:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b2b72c10-6733-4e44-96b2-2b9d774a5a5e tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-db9e05d1-290d-4f5b-86bf-e668747bf6b1-delete_snapshot" released by "delete_snapshot" :: held 6.038s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "cinder-b75fa180-6c48-4e6d-846d-156596ddcb36-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-b75fa180-6c48-4e6d-846d-156596ddcb36-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c331d7-c84b-4b93-882c-25545bb85c11]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:21 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 Jul 09 09:19:21 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Flow 'volume_create_manager' (38508a56-4d57-47f8-8a70-a21b13a9923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5535b6-1931-4ed8-bd54-261a72ce198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5535b6-1931-4ed8-bd54-261a72ce198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104677100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff32d86-9f74-4d1f-a613-00882667d649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c7c08e469846a3881e28559aa18c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:22Z,use_quota=True,user_id='be975df0aa7d46ce8a22d3451f0e89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd512329-ae91-49a4-bede-ddedff541702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd512329-ae91-49a4-bede-ddedff541702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48645ed5-0161-4f9e-b965-b22016077105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48645ed5-0161-4f9e-b965-b22016077105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff32d86-9f74-4d1f-a613-00882667d649', 'volume_name': 'volume-6ff32d86-9f74-4d1f-a613-00882667d649', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc50cc12-5644-4204-81ae-273bf1a3861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc50cc12-5644-4204-81ae-273bf1a3861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2307a3-0ac1-4fbb-b595-673604880766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Volume 6ff32d86-9f74-4d1f-a613-00882667d649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff32d86-9f74-4d1f-a613-00882667d649', 'volume_size': 1} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104677100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff32d86-9f74-4d1f-a613-00882667d649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c7c08e469846a3881e28559aa18c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:22Z,use_quota=True,user_id='be975df0aa7d46ce8a22d3451f0e89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Creating volume 6ff32d86-9f74-4d1f-a613-00882667d649 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:22 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:19:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36" returned: 0 in 1.536s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:22 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 1073741824 Jul 09 09:19:22 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:22 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36 Jul 09 09:19:22 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:23 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b75fa180-6c48-4e6d-846d-156596ddcb36" returned: 0 in 1.112s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-quobyte-b75fa180-6c48-4e6d-846d-156596ddcb36" released by "delete_volume" :: held 2.795s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Created reservations ['5e6d41c4-b953-49d2-9e0c-855a9d3ce8f8', '8b8632b5-6ea5-404a-abab-6ee2898d534c', '338a8a59-3743-4cda-a748-d0355d32949b', 'd6041a2a-b72f-4b3b-a509-6f93c1aca36b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:23 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:19:23 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:24 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 1073741824" returned: 0 in 1.727s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:24 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 Jul 09 09:19:24 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:24 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.227s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:24 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:19:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Deleted volume successfully. Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-64e1acc0-ec86-44ef-81ac-23d0a899ecd2 tempest-SnapshotsActionsTest-1683432630 None] Lock "cinder-b75fa180-6c48-4e6d-846d-156596ddcb36-delete_volume" released by "delete_volume" :: held 4.440s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:25 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649" returned: 0 in 1.693s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] <== create_volume: return (3509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.516s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2307a3-0ac1-4fbb-b595-673604880766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff32d86-9f74-4d1f-a613-00882667d649', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a523f59-7aff-44fa-aa69-c5fbd5630190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Volume volume-6ff32d86-9f74-4d1f-a613-00882667d649 (6ff32d86-9f74-4d1f-a613-00882667d649): created successfully Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a523f59-7aff-44fa-aa69-c5fbd5630190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Flow 'volume_create_manager' (38508a56-4d57-47f8-8a70-a21b13a9923f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-643c02a6-59fc-4a0b-bb5a-c94408af1316 tempest-ServerRescueNegativeTestJSON-1350401351 None] Created volume successfully. Jul 09 09:19:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:INSERT=5,cinder:UPDATE=22,cinder:SELECT=13 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:19:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Flow 'volume_create_manager' (7bcda8bd-6a13-451b-99cb-f58bd6f600a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814a9acf-6c0b-459a-9b9e-39d13be62712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814a9acf-6c0b-459a-9b9e-39d13be62712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254926662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1372da81-add1-437a-8d51-86eff98dcec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971e09d660404b8f839cc2424dbe46df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:41Z,use_quota=True,user_id='3dc450a146954ca79cd097d916f16166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3c0fec-a315-4dfa-8f9c-511c1bfa4574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3c0fec-a315-4dfa-8f9c-511c1bfa4574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d2ce79-2bb0-4870-a9fa-3c13074e0dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d2ce79-2bb0-4870-a9fa-3c13074e0dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1372da81-add1-437a-8d51-86eff98dcec8', 'volume_name': 'volume-1372da81-add1-437a-8d51-86eff98dcec8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa9cf7d-381d-46fb-bb77-ba44b30f9120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa9cf7d-381d-46fb-bb77-ba44b30f9120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eba9ea-7589-490e-9d56-8c6d423236ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume 1372da81-add1-437a-8d51-86eff98dcec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1372da81-add1-437a-8d51-86eff98dcec8', 'volume_size': 1} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-254926662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1372da81-add1-437a-8d51-86eff98dcec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971e09d660404b8f839cc2424dbe46df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:41Z,use_quota=True,user_id='3dc450a146954ca79cd097d916f16166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Creating volume 1372da81-add1-437a-8d51-86eff98dcec8 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:19:41 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:19:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:41 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 1073741824 Jul 09 09:19:41 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:42 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 1073741824" returned: 0 in 1.475s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:42 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 Jul 09 09:19:42 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:43 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8" returned: 0 in 0.800s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eba9ea-7589-490e-9d56-8c6d423236ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1372da81-add1-437a-8d51-86eff98dcec8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533d898f-41e0-4d3d-9b92-bd7b51b5af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:43 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume volume-1372da81-add1-437a-8d51-86eff98dcec8 (1372da81-add1-437a-8d51-86eff98dcec8): created successfully Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533d898f-41e0-4d3d-9b92-bd7b51b5af83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Flow 'volume_create_manager' (7bcda8bd-6a13-451b-99cb-f58bd6f600a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4443c79f-5f6e-476f-aaac-50463f400952 tempest-VolumeQuotasAdminTestJSON-329816569 None] Created volume successfully. Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "cinder-1372da81-add1-437a-8d51-86eff98dcec8-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "cinder-1372da81-add1-437a-8d51-86eff98dcec8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "cinder-quobyte-1372da81-add1-437a-8d51-86eff98dcec8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "cinder-quobyte-1372da81-add1-437a-8d51-86eff98dcec8" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0a5b44-41e2-45c2-aa92-ac14586dd862]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:44 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 Jul 09 09:19:44 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:45 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8" returned: 0 in 0.797s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:45 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8 Jul 09 09:19:45 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:45 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1372da81-add1-437a-8d51-86eff98dcec8" returned: 0 in 0.899s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "cinder-quobyte-1372da81-add1-437a-8d51-86eff98dcec8" released by "delete_volume" :: held 1.794s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Created reservations ['94f8333d-12f2-4454-8e36-be8ce7ff39da', '04ace8f7-71a2-4786-bc92-5ddf348e92c4', '83a91b07-78c7-4183-bfca-4e6d1cf6bd83', '8058f37c-58a5-43fb-a3ac-f21b031d3415'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:46 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:19:46 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Acquiring lock "cinder-6ff32d86-9f74-4d1f-a613-00882667d649-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "cinder-6ff32d86-9f74-4d1f-a613-00882667d649-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Acquiring lock "cinder-quobyte-6ff32d86-9f74-4d1f-a613-00882667d649" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "cinder-quobyte-6ff32d86-9f74-4d1f-a613-00882667d649" acquired by "delete_volume" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[414d9fbb-08fc-4c05-ade3-195d515ade45]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:47 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 Jul 09 09:19:47 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Flow 'volume_create_manager' (423266c8-82d6-4c88-a397-1e90a936fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeef26ce-927f-48b7-ab44-4e9e6472d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeef26ce-927f-48b7-ab44-4e9e6472d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-570963701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c139872f-ca8c-4aca-a339-f0598e432595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971e09d660404b8f839cc2424dbe46df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:48Z,use_quota=True,user_id='3dc450a146954ca79cd097d916f16166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2681c2-6f2a-43b6-b9bf-f552b651a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2681c2-6f2a-43b6-b9bf-f552b651a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784cd29d-30ed-497c-98e2-02f309594c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784cd29d-30ed-497c-98e2-02f309594c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c139872f-ca8c-4aca-a339-f0598e432595', 'volume_name': 'volume-c139872f-ca8c-4aca-a339-f0598e432595', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c05703-ee69-489c-88e2-388c5cedbf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c05703-ee69-489c-88e2-388c5cedbf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b063224-3d8f-4b1c-ad48-8d45960db2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume c139872f-ca8c-4aca-a339-f0598e432595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c139872f-ca8c-4aca-a339-f0598e432595', 'volume_size': 1} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-570963701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c139872f-ca8c-4aca-a339-f0598e432595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971e09d660404b8f839cc2424dbe46df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:19:48Z,use_quota=True,user_id='3dc450a146954ca79cd097d916f16166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Creating volume c139872f-ca8c-4aca-a339-f0598e432595 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:19:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:48 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 1073741824 Jul 09 09:19:48 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:48 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:19:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Deleted volume successfully. Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a591586-29d6-4aee-add0-7fd7c52e4dcb tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "cinder-1372da81-add1-437a-8d51-86eff98dcec8-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:48 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649" returned: 0 in 1.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:48 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649 Jul 09 09:19:48 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:49 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 1073741824" returned: 0 in 1.512s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:49 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 Jul 09 09:19:49 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:49 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ff32d86-9f74-4d1f-a613-00882667d649" returned: 0 in 1.045s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "cinder-quobyte-6ff32d86-9f74-4d1f-a613-00882667d649" released by "delete_volume" :: held 2.918s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Created reservations ['22fae7b9-a76a-47f3-8665-1bbddd540cc9', '44640933-1d85-4e59-8baa-54097c53f063', '034e481b-e2ea-4e92-a72b-49b5e63c4326', 'd84c5dca-c166-4b78-965f-cd0016127117'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:50 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:19:50 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:50 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:19:50 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:51 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595" returned: 0 in 1.558s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] <== create_volume: return (3161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.166s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b063224-3d8f-4b1c-ad48-8d45960db2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c139872f-ca8c-4aca-a339-f0598e432595', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916063e2-829a-447b-a3a0-1ac98f6b61d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:19:51 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Volume volume-c139872f-ca8c-4aca-a339-f0598e432595 (c139872f-ca8c-4aca-a339-f0598e432595): created successfully Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916063e2-829a-447b-a3a0-1ac98f6b61d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Flow 'volume_create_manager' (423266c8-82d6-4c88-a397-1e90a936fb46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:19:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-91b5ea31-77f4-4b7c-b14e-9b8a2b5ac170 tempest-VolumeQuotasAdminTestJSON-329816569 None] Created volume successfully. Jul 09 09:19:51 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.379s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:19:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Deleted volume successfully. Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b1d54de-0aaf-40d0-8ebd-dc58964aaa4e tempest-ServerRescueNegativeTestJSON-1350401351 None] Lock "cinder-6ff32d86-9f74-4d1f-a613-00882667d649-delete_volume" released by "delete_volume" :: held 4.746s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:51 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.322s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 8 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:19:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-b56ce125-a99c-4518-b398-ce7423e7d8ab req-b777ab00-fab9-4746-a5b3-aee86bdc1a98 tempest-AttachVolumeTestJSON-1898156594 None] Terminate volume connection completed successfully. Jul 09 09:19:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-b56ce125-a99c-4518-b398-ce7423e7d8ab req-b777ab00-fab9-4746-a5b3-aee86bdc1a98 tempest-AttachVolumeTestJSON-1898156594 None] Deleting attachment aac5bfc6-fc63-4262-a113-9373435804fa. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:19:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a479d781-20c6-4904-8a16-ce5b50209966 tempest-VolumeQuotasAdminTestJSON-1920978696 None] Transfer volume completed successfully. Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Acquiring lock "cinder-c139872f-ca8c-4aca-a339-f0598e432595-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "cinder-c139872f-ca8c-4aca-a339-f0598e432595-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Acquiring lock "cinder-quobyte-c139872f-ca8c-4aca-a339-f0598e432595" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "cinder-quobyte-c139872f-ca8c-4aca-a339-f0598e432595" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bb97ed-92ca-4985-99c2-6c49213daa87]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:19:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:55 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 Jul 09 09:19:55 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:56 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595" returned: 0 in 0.961s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:56 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595 Jul 09 09:19:56 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:57 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c139872f-ca8c-4aca-a339-f0598e432595" returned: 0 in 1.194s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "cinder-quobyte-c139872f-ca8c-4aca-a339-f0598e432595" released by "delete_volume" :: held 2.235s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Created reservations ['8c5ed985-995e-4bd4-bc8f-1cf0d4711c20', '79156c49-14dd-407c-8755-7a8525815b43', '5e985c9c-3700-48fe-8957-b241c70036ed', '89a44b6f-18d7-4024-93a4-6924511f7589'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:19:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:19:58 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:19:58 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:19:58 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Jul 09 09:19:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:19:58 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:19:58 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Deleted volume successfully. Jul 09 09:19:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b35304fe-b798-44e2-9e86-2a8dba74eaed tempest-VolumeQuotasAdminTestJSON-1978673181 None] Lock "cinder-c139872f-ca8c-4aca-a339-f0598e432595-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:07 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=35,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:20:08 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Flow 'volume_create_manager' (7d9343eb-a44d-4f59-81ac-d8b912ff696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d4ba8e-bf2d-4fd9-9a72-44cae74282db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d4ba8e-bf2d-4fd9-9a72-44cae74282db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-134184903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36200221-97f8-4fcb-a9f1-7c8fbabb2dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d5704561b246f0933469ae84df1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:15Z,use_quota=True,user_id='87bd5496578b4fc49a498f4fcfb96b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00781c6a-5a94-4025-b109-24338a35d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00781c6a-5a94-4025-b109-24338a35d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8ef42c-08b5-4d91-8375-2346c29a83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8ef42c-08b5-4d91-8375-2346c29a83fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36200221-97f8-4fcb-a9f1-7c8fbabb2dd2', 'volume_name': 'volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e1c768-d40f-456a-844d-58d35f558d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e1c768-d40f-456a-844d-58d35f558d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6a858d-393e-47d0-9f3e-6d25f096f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:15 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Volume 36200221-97f8-4fcb-a9f1-7c8fbabb2dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2', 'volume_size': 1} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-134184903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36200221-97f8-4fcb-a9f1-7c8fbabb2dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d5704561b246f0933469ae84df1959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:15Z,use_quota=True,user_id='87bd5496578b4fc49a498f4fcfb96b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Creating volume 36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:15 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:15 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 1073741824 Jul 09 09:20:15 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (8e122e5e-3777-44c5-af25-8710c8fd9c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d69dd69-1a97-4e28-9bbf-4e58f61ef1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d69dd69-1a97-4e28-9bbf-4e58f61ef1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-772271639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39279f63-9acb-4368-bce1-416e3a0e396a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:16Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be362aba-fd8a-44c5-a784-d3c5e7fec9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be362aba-fd8a-44c5-a784-d3c5e7fec9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ac0cf2-ba5c-4107-a859-7e2801d36cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ac0cf2-ba5c-4107-a859-7e2801d36cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39279f63-9acb-4368-bce1-416e3a0e396a', 'volume_name': 'volume-39279f63-9acb-4368-bce1-416e3a0e396a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea321a-3aa7-455d-a0f6-b6dcdf61a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ea321a-3aa7-455d-a0f6-b6dcdf61a064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73a37c-583f-4367-a522-a543dbc49ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Volume 39279f63-9acb-4368-bce1-416e3a0e396a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39279f63-9acb-4368-bce1-416e3a0e396a', 'volume_size': 1} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:16 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 1073741824" returned: 0 in 1.243s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:16 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 Jul 09 09:20:16 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:17 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" returned: 0 in 0.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-772271639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39279f63-9acb-4368-bce1-416e3a0e396a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:16Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Creating volume 39279f63-9acb-4368-bce1-416e3a0e396a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:17 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6a858d-393e-47d0-9f3e-6d25f096f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:17 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a 1073741824 Jul 09 09:20:17 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9514663-44e1-43f4-bbc8-d5c212c861a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:17 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Volume volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 (36200221-97f8-4fcb-a9f1-7c8fbabb2dd2): created successfully Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9514663-44e1-43f4-bbc8-d5c212c861a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Flow 'volume_create_manager' (7d9343eb-a44d-4f59-81ac-d8b912ff696c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-55b5899e-6c2c-45eb-9fe4-e5743179a7ee tempest-AttachVolumeShelveTestJSON-758486397 None] Created volume successfully. Jul 09 09:20:18 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a 1073741824" returned: 0 in 1.318s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:19 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a Jul 09 09:20:19 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:19 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a" returned: 0 in 0.863s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73a37c-583f-4367-a522-a543dbc49ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39279f63-9acb-4368-bce1-416e3a0e396a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6067236b-2489-4308-8ed4-1767f42a7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:19 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Volume volume-39279f63-9acb-4368-bce1-416e3a0e396a (39279f63-9acb-4368-bce1-416e3a0e396a): created successfully Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6067236b-2489-4308-8ed4-1767f42a7b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (8e122e5e-3777-44c5-af25-8710c8fd9c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c69248f1-282b-4033-ab01-db2feeb29be7 tempest-VolumesListAdminTestJSON-461551722 None] Created volume successfully. Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (bfab804d-743b-4bd0-8037-7d69e0628c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8dd37b-d65b-4aaf-b744-529d2e6aff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8dd37b-d65b-4aaf-b744-529d2e6aff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-643916836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8713ef-0fcb-4821-9d1c-87f724011069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a57785e-9645-4662-80a9-192a8a24b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a57785e-9645-4662-80a9-192a8a24b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce419865-e2da-4067-99df-4a00e3d2fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce419865-e2da-4067-99df-4a00e3d2fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8713ef-0fcb-4821-9d1c-87f724011069', 'volume_name': 'volume-ee8713ef-0fcb-4821-9d1c-87f724011069', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa66e32-323f-4366-a655-690306c5bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa66e32-323f-4366-a655-690306c5bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612f69c3-7133-4dff-9226-33d9bae91b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Volume ee8713ef-0fcb-4821-9d1c-87f724011069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8713ef-0fcb-4821-9d1c-87f724011069', 'volume_size': 1} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-643916836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8713ef-0fcb-4821-9d1c-87f724011069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Creating volume ee8713ef-0fcb-4821-9d1c-87f724011069 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:21 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:21 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 1073741824 Jul 09 09:20:21 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:22 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 1073741824" returned: 0 in 0.949s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:22 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 Jul 09 09:20:22 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Flow 'volume_create_manager' (5a0b7204-6585-405f-8793-4cc91e108d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655cc01-e84f-4aeb-950c-b6637847c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655cc01-e84f-4aeb-950c-b6637847c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-103351798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fef15d6-62d7-4fa7-abff-3a2f97557488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fd24643554457a8ecae007de43f3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:23Z,use_quota=True,user_id='fc9b7ff6c72441aeacdf5eb85f42205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31029b4c-9cc2-4b60-b8a6-df77b9d70dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31029b4c-9cc2-4b60-b8a6-df77b9d70dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1cbb12-87c8-4411-800d-db755c89d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1cbb12-87c8-4411-800d-db755c89d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fef15d6-62d7-4fa7-abff-3a2f97557488', 'volume_name': 'volume-7fef15d6-62d7-4fa7-abff-3a2f97557488', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f088a1df-acfa-40c9-94b9-0555f51a3ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f088a1df-acfa-40c9-94b9-0555f51a3ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb95dbe3-9492-427e-a6ab-1d5d134973b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Volume 7fef15d6-62d7-4fa7-abff-3a2f97557488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fef15d6-62d7-4fa7-abff-3a2f97557488', 'volume_size': 1} Jul 09 09:20:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:23 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069" returned: 0 in 0.652s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.421s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-103351798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fef15d6-62d7-4fa7-abff-3a2f97557488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fd24643554457a8ecae007de43f3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:23Z,use_quota=True,user_id='fc9b7ff6c72441aeacdf5eb85f42205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Creating volume 7fef15d6-62d7-4fa7-abff-3a2f97557488 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:23 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:23 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 1073741824 Jul 09 09:20:23 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612f69c3-7133-4dff-9226-33d9bae91b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8713ef-0fcb-4821-9d1c-87f724011069', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d28c2c5-658e-4255-aa19-9e52e5ab0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:23 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Volume volume-ee8713ef-0fcb-4821-9d1c-87f724011069 (ee8713ef-0fcb-4821-9d1c-87f724011069): created successfully Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d28c2c5-658e-4255-aa19-9e52e5ab0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (bfab804d-743b-4bd0-8037-7d69e0628c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:23 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ecc41cd7-41ad-4daf-9ec6-8e1e34581ca2 tempest-VolumesListAdminTestJSON-461551722 None] Created volume successfully. Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (f036a01a-4bef-4d1b-b2d2-2c7be02f30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26af184-b1a9-49bc-923f-7b9f665f2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26af184-b1a9-49bc-923f-7b9f665f2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1013890221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658e1967-6bd7-4405-a624-3da2c80bb109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:24Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d048bc4d-1d1e-423e-b3ff-62f32830cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d048bc4d-1d1e-423e-b3ff-62f32830cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78291ce-d566-454d-8250-36f85e787d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78291ce-d566-454d-8250-36f85e787d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658e1967-6bd7-4405-a624-3da2c80bb109', 'volume_name': 'volume-658e1967-6bd7-4405-a624-3da2c80bb109', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9968a78-bdb8-4928-a54c-ebe1aa2a9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9968a78-bdb8-4928-a54c-ebe1aa2a9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a99230-b27f-4140-8d53-ffa6a90311d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Volume 658e1967-6bd7-4405-a624-3da2c80bb109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658e1967-6bd7-4405-a624-3da2c80bb109', 'volume_size': 1} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 1073741824" returned: 0 in 0.934s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:24 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 Jul 09 09:20:24 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:24 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488" returned: 0 in 0.682s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1013890221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658e1967-6bd7-4405-a624-3da2c80bb109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23a271110d4fd98a8d8e6c457712cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:24Z,use_quota=True,user_id='9afcc538c4c94916a7d099752fb12248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Creating volume 658e1967-6bd7-4405-a624-3da2c80bb109 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:24 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 1073741824 Jul 09 09:20:24 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb95dbe3-9492-427e-a6ab-1d5d134973b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fef15d6-62d7-4fa7-abff-3a2f97557488', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4404ccac-e0e4-4d54-8b1d-c4d3c3a5d45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Volume volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 (7fef15d6-62d7-4fa7-abff-3a2f97557488): created successfully Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4404ccac-e0e4-4d54-8b1d-c4d3c3a5d45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Flow 'volume_create_manager' (5a0b7204-6585-405f-8793-4cc91e108d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f2e3e506-bfa1-4d1f-90f8-f22411b707ed tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Created volume successfully. Jul 09 09:20:25 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 1073741824" returned: 0 in 0.868s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:25 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 Jul 09 09:20:25 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:26 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109" returned: 0 in 0.852s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a99230-b27f-4140-8d53-ffa6a90311d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658e1967-6bd7-4405-a624-3da2c80bb109', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d021d1f-270a-4e8e-ac69-6311f122cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Volume volume-658e1967-6bd7-4405-a624-3da2c80bb109 (658e1967-6bd7-4405-a624-3da2c80bb109): created successfully Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d021d1f-270a-4e8e-ac69-6311f122cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Flow 'volume_create_manager' (f036a01a-4bef-4d1b-b2d2-2c7be02f30a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:26 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-39d8631d-6522-4a1a-b0d3-117f624ce86e tempest-VolumesListAdminTestJSON-461551722 None] Created volume successfully. Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Acquiring lock "cinder-7fef15d6-62d7-4fa7-abff-3a2f97557488-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "cinder-7fef15d6-62d7-4fa7-abff-3a2f97557488-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Acquiring lock "cinder-quobyte-7fef15d6-62d7-4fa7-abff-3a2f97557488" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "cinder-quobyte-7fef15d6-62d7-4fa7-abff-3a2f97557488" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746d695-718d-4c3a-9600-a26573ad30f4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:27 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 Jul 09 09:20:27 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Flow 'volume_create_manager' (cfba0791-fd9f-4e58-b16b-c24eabf26369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173b9332-46b6-4f93-8588-a38ffcd07ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173b9332-46b6-4f93-8588-a38ffcd07ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77611a2-7ffb-45b7-836c-224434fdd652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9922ea03e70d459fb326c1b480183b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:28Z,use_quota=True,user_id='20b7b2ea7e414baba1be14bdc97807d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9d2af4-92bd-4f08-ac3e-60573029827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9d2af4-92bd-4f08-ac3e-60573029827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ea1c03-37ac-4d21-b7b7-63907e805c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ea1c03-37ac-4d21-b7b7-63907e805c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77611a2-7ffb-45b7-836c-224434fdd652', 'volume_name': 'volume-e77611a2-7ffb-45b7-836c-224434fdd652', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f41910-70fe-44d4-81c3-d6579be4dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f41910-70fe-44d4-81c3-d6579be4dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee64f4db-b72f-4119-9a56-d109895587c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Volume e77611a2-7ffb-45b7-836c-224434fdd652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77611a2-7ffb-45b7-836c-224434fdd652', 'volume_size': 1} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77611a2-7ffb-45b7-836c-224434fdd652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9922ea03e70d459fb326c1b480183b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:28Z,use_quota=True,user_id='20b7b2ea7e414baba1be14bdc97807d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Creating volume e77611a2-7ffb-45b7-836c-224434fdd652 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:28 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:28 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 1073741824 Jul 09 09:20:28 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:28 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488" returned: 0 in 0.898s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:28 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488 Jul 09 09:20:28 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:29 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 1073741824" returned: 0 in 0.913s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:29 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7fef15d6-62d7-4fa7-abff-3a2f97557488" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "cinder-quobyte-7fef15d6-62d7-4fa7-abff-3a2f97557488" released by "delete_volume" :: held 1.766s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:29 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 Jul 09 09:20:29 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Created reservations ['cf2c9e80-f4bb-4985-a457-0bc11b1d578e', 'caaee5e0-cd9f-4e61-b246-604e27a08b90', 'b7b00df7-0db2-472b-a64e-8afcec7f1513', '4f4e098b-9357-41e2-9b34-19e952536ed7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:29 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:29 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:30 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652" returned: 0 in 0.826s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee64f4db-b72f-4119-9a56-d109895587c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77611a2-7ffb-45b7-836c-224434fdd652', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e6bc9-64cf-44ff-8434-a1502f69dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:30 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Volume volume-e77611a2-7ffb-45b7-836c-224434fdd652 (e77611a2-7ffb-45b7-836c-224434fdd652): created successfully Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4e6bc9-64cf-44ff-8434-a1502f69dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Flow 'volume_create_manager' (cfba0791-fd9f-4e58-b16b-c24eabf26369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:30 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.809s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-53608499-5fc0-44fa-a320-55c5e0ea09ff tempest-VolumesListAdminTestJSON-464731394 None] Created volume successfully. Jul 09 09:20:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Deleted volume successfully. Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-89886804-54ef-4e0a-9ad3-0c72af1b0ccf tempest-VolumeQuotasNegativeTestJSON-1881447948 None] Lock "cinder-7fef15d6-62d7-4fa7-abff-3a2f97557488-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Acquiring lock "cinder-e77611a2-7ffb-45b7-836c-224434fdd652-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "cinder-e77611a2-7ffb-45b7-836c-224434fdd652-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Acquiring lock "cinder-quobyte-e77611a2-7ffb-45b7-836c-224434fdd652" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "cinder-quobyte-e77611a2-7ffb-45b7-836c-224434fdd652" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[16119523-2916-454f-abfd-38e1cc311e8b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-658e1967-6bd7-4405-a624-3da2c80bb109-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-658e1967-6bd7-4405-a624-3da2c80bb109-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-quobyte-658e1967-6bd7-4405-a624-3da2c80bb109" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-658e1967-6bd7-4405-a624-3da2c80bb109" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:30 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 Jul 09 09:20:30 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ec0226-f44e-4ecb-99ae-6693b444d82d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:30 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 Jul 09 09:20:30 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:31 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652" returned: 0 in 1.077s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:31 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652 Jul 09 09:20:31 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:31 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109" returned: 0 in 1.124s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:31 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109 Jul 09 09:20:31 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:32 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e77611a2-7ffb-45b7-836c-224434fdd652" returned: 0 in 1.021s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "cinder-quobyte-e77611a2-7ffb-45b7-836c-224434fdd652" released by "delete_volume" :: held 2.154s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Created reservations ['e92d3d13-c83d-4bd9-b1dd-098f3c2d5297', '6a69bdcf-84bb-44cd-8145-609fb89080e7', 'f8e17c5b-132f-4b8e-97f6-e3b42c8d0fcc', '483904f5-c4de-4a0e-9620-a75bec97a645'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:32 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-658e1967-6bd7-4405-a624-3da2c80bb109" returned: 0 in 1.021s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-658e1967-6bd7-4405-a624-3da2c80bb109" released by "delete_volume" :: held 2.213s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:32 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:32 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Created reservations ['d1d1b09e-f4eb-46ba-9dad-ff1baa7a6dec', 'fe838c41-6fbf-40aa-81a0-5f269bb381aa', '8cdcdd01-3267-43bd-bff9-0385da108990', '96756c50-a5a5-4a9a-8105-819eddf69449'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:33 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:33 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:33 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.799s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Deleted volume successfully. Jul 09 09:20:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-541cb100-792c-46fc-b726-618f0c80a886 tempest-VolumesListAdminTestJSON-464731394 None] Lock "cinder-e77611a2-7ffb-45b7-836c-224434fdd652-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-ee8713ef-0fcb-4821-9d1c-87f724011069-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:34 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.944s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-ee8713ef-0fcb-4821-9d1c-87f724011069-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Deleted volume successfully. Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6eff8a4-cd38-46b0-909b-5dba0268eeb6 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-658e1967-6bd7-4405-a624-3da2c80bb109-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-quobyte-ee8713ef-0fcb-4821-9d1c-87f724011069" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-ee8713ef-0fcb-4821-9d1c-87f724011069" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920b1b6-c3d7-4d08-819a-d9181271de5c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:34 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 Jul 09 09:20:34 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:35 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069" returned: 0 in 0.867s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:35 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069 Jul 09 09:20:35 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:35 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ee8713ef-0fcb-4821-9d1c-87f724011069" returned: 0 in 0.893s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-ee8713ef-0fcb-4821-9d1c-87f724011069" released by "delete_volume" :: held 1.811s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Created reservations ['948bbf26-7264-4d7f-b13b-8c781563dadb', 'a0cbcf8c-41f8-4933-a989-f068aea2c7e3', 'df09e75f-b9e1-4fcf-a3a7-6fd464fcdf62', '59a5f329-9bd8-4aed-bf0a-c908ab201b50'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:36 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:36 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-39279f63-9acb-4368-bce1-416e3a0e396a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-39279f63-9acb-4368-bce1-416e3a0e396a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "cinder-quobyte-39279f63-9acb-4368-bce1-416e3a0e396a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-39279f63-9acb-4368-bce1-416e3a0e396a" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef7e985-426c-4b99-9748-0e6b22e3b393]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:36 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a Jul 09 09:20:36 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:36 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.870s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:36 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Deleted volume successfully. Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6e9448fb-3167-4e48-be30-7675d3572199 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-ee8713ef-0fcb-4821-9d1c-87f724011069-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Flow 'volume_create_manager' (51154ac9-248c-4acc-b014-f7d0e8d2cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5726a5b8-c9a4-48e7-a18c-f197bba1831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5726a5b8-c9a4-48e7-a18c-f197bba1831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1540455629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032b76ca-23ba-4ba5-9c35-da26173c8c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f110cecba3943dc97a12a005553a332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:38Z,use_quota=True,user_id='a9530bf765e84a6e9b02761332a3af18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc83626-43a7-4f9c-b02c-00c620a77155),volume_type_id=0bc83626-43a7-4f9c-b02c-00c620a77155)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29816451-eb8d-4e80-b332-c48a6f640c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29816451-eb8d-4e80-b332-c48a6f640c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9aadbe-eef2-49d3-b434-41a4b5a36ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9aadbe-eef2-49d3-b434-41a4b5a36ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032b76ca-23ba-4ba5-9c35-da26173c8c3f', 'volume_name': 'volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54eece39-714b-429e-b440-43d86d7e1867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54eece39-714b-429e-b440-43d86d7e1867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd64a4d-ca79-408c-97f6-25bdd602b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Volume 032b76ca-23ba-4ba5-9c35-da26173c8c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f', 'volume_size': 1} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1540455629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032b76ca-23ba-4ba5-9c35-da26173c8c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f110cecba3943dc97a12a005553a332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:38Z,use_quota=True,user_id='a9530bf765e84a6e9b02761332a3af18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc83626-43a7-4f9c-b02c-00c620a77155),volume_type_id=0bc83626-43a7-4f9c-b02c-00c620a77155)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Creating volume 032b76ca-23ba-4ba5-9c35-da26173c8c3f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:37 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:37 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f 1073741824 Jul 09 09:20:37 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:37 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a" returned: 0 in 1.059s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:37 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a Jul 09 09:20:37 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-49149859-ab06-4df2-b310-e19a389b6f74 req-2676fd52-7447-47e6-9691-cc0e1637e27e tempest-AttachVolumeShelveTestJSON-758486397 None] No connector for attachment eb4074a7-45c1-4fff-ad4b-ddbf950c0e94; skipping storage backend terminate_connection call. {{(pid=87265) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-49149859-ab06-4df2-b310-e19a389b6f74 req-2676fd52-7447-47e6-9691-cc0e1637e27e tempest-AttachVolumeShelveTestJSON-758486397 None] Deleting attachment eb4074a7-45c1-4fff-ad4b-ddbf950c0e94. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:20:38 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-39279f63-9acb-4368-bce1-416e3a0e396a" returned: 0 in 0.810s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-quobyte-39279f63-9acb-4368-bce1-416e3a0e396a" released by "delete_volume" :: held 1.966s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:38 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Created reservations ['fce5eece-ce0c-404e-9736-4e9925618e7c', '2c41c49e-51a9-4338-9b72-11b0a9664251', '27415979-4e8c-4295-9ef3-c476c474230e', '48ef7040-44f0-45a3-b13a-5aeb0896bb3f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f 1073741824" returned: 0 in 1.050s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:38 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f Jul 09 09:20:38 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:38 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:38 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:39 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f" returned: 0 in 1.176s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:39 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.142s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Deleted volume successfully. Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd64a4d-ca79-408c-97f6-25bdd602b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0ee8e-51e2-41b9-a253-0d39e350a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-54c98a36-6978-4119-aac0-f35838115bb3 tempest-VolumesListAdminTestJSON-461551722 None] Lock "cinder-39279f63-9acb-4368-bce1-416e3a0e396a-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Volume volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f (032b76ca-23ba-4ba5-9c35-da26173c8c3f): created successfully Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0ee8e-51e2-41b9-a253-0d39e350a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Flow 'volume_create_manager' (51154ac9-248c-4acc-b014-f7d0e8d2cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d541cac5-5eac-4451-94bd-32a55c11266d tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Created volume successfully. Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:41 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:41 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:42 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.792s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-31d7f11b-9f6a-4d03-87e3-2f02527e36d3 tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Retype volume completed successfully. Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "cinder-032b76ca-23ba-4ba5-9c35-da26173c8c3f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "cinder-032b76ca-23ba-4ba5-9c35-da26173c8c3f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "cinder-quobyte-032b76ca-23ba-4ba5-9c35-da26173c8c3f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "cinder-quobyte-032b76ca-23ba-4ba5-9c35-da26173c8c3f" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3587698-1310-44a2-ae6f-e19e98472643]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:42 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f Jul 09 09:20:42 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:43 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:43 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f Jul 09 09:20:43 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:44 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-032b76ca-23ba-4ba5-9c35-da26173c8c3f" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "cinder-quobyte-032b76ca-23ba-4ba5-9c35-da26173c8c3f" released by "delete_volume" :: held 1.638s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:44 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:20:44 devstack cinder-volume[87265]: WARNING cinder.quota [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Created reservations ['115a55dc-ec2e-4dc0-ad4c-434fae10d0ed', '676f6e0c-5972-48ba-9eab-6a236da241a3', '63be2427-cf17-41e4-898a-b3c491f05194', '77a916be-6202-413c-bbb3-d9d44898a64a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:44 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:44 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:45 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:45 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Deleted volume successfully. Jul 09 09:20:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ff4e0cd1-aca0-449a-9820-c48a18dec64a tempest-VolumeRetypeWithoutMigrationTest-491688897 None] Lock "cinder-032b76ca-23ba-4ba5-9c35-da26173c8c3f-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Flow 'volume_create_manager' (46cd89d3-0581-4f80-8d93-9cbdde70ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62444bc4-0a66-43cf-a4c3-378d1754145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62444bc4-0a66-43cf-a4c3-378d1754145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1306959255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c6e563-2414-422b-9a58-db86507207ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9578173e58c54c239e5510ceb6cb9755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:48Z,use_quota=True,user_id='89190a00c81644049a1bfc9b862d4648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cb4231-6f3c-4f55-81ed-659ff1923877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cb4231-6f3c-4f55-81ed-659ff1923877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e67077-7876-4bc5-85d8-a58d96a11dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e67077-7876-4bc5-85d8-a58d96a11dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c6e563-2414-422b-9a58-db86507207ae', 'volume_name': 'volume-c8c6e563-2414-422b-9a58-db86507207ae', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30c38db-6981-4281-b16c-8a5d0f07dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30c38db-6981-4281-b16c-8a5d0f07dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60800366-d52a-4e92-9f31-77edb81099e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:47 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Volume c8c6e563-2414-422b-9a58-db86507207ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c6e563-2414-422b-9a58-db86507207ae', 'volume_size': 1} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1306959255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c6e563-2414-422b-9a58-db86507207ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9578173e58c54c239e5510ceb6cb9755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:48Z,use_quota=True,user_id='89190a00c81644049a1bfc9b862d4648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Creating volume c8c6e563-2414-422b-9a58-db86507207ae {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:47 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:47 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae 1073741824 Jul 09 09:20:47 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:48 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae 1073741824" returned: 0 in 1.010s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:48 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae Jul 09 09:20:48 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:49 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae" returned: 0 in 0.671s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60800366-d52a-4e92-9f31-77edb81099e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c6e563-2414-422b-9a58-db86507207ae', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47062c5f-1b88-4d97-9499-6a7fd16fa329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Volume volume-c8c6e563-2414-422b-9a58-db86507207ae (c8c6e563-2414-422b-9a58-db86507207ae): created successfully Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47062c5f-1b88-4d97-9499-6a7fd16fa329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Flow 'volume_create_manager' (46cd89d3-0581-4f80-8d93-9cbdde70ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cd439eec-906e-4a16-b4ec-c3237620f037 tempest-VolumesMetadataTest-1949166450 None] Created volume successfully. Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:50 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:50 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Acquiring lock "cinder-c8c6e563-2414-422b-9a58-db86507207ae-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "cinder-c8c6e563-2414-422b-9a58-db86507207ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Acquiring lock "cinder-quobyte-c8c6e563-2414-422b-9a58-db86507207ae" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "cinder-quobyte-c8c6e563-2414-422b-9a58-db86507207ae" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e1cd5-a573-45a8-8ecf-506f6c9e70fe]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:20:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:51 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae Jul 09 09:20:51 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:51 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.118s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:52 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae" returned: 0 in 1.252s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:52 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae Jul 09 09:20:52 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:53 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8c6e563-2414-422b-9a58-db86507207ae" returned: 0 in 1.003s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "cinder-quobyte-c8c6e563-2414-422b-9a58-db86507207ae" released by "delete_volume" :: held 2.401s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Created reservations ['4597a9c2-7030-47c1-864c-7a20935716f1', 'fe260886-b922-4a31-b652-3ca06b459bee', '617c70f5-7fb8-4eb0-a79e-7fd77d6b9f5e', 'eb2c3c9a-267e-47c4-b5bf-4d80e5503fa9'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:53 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:20:53 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:20:54 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 09 09:20:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.852s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:20:54 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:20:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Deleted volume successfully. Jul 09 09:20:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0cea05c0-7fb2-4971-a8c4-7fa4d88bdd4c tempest-VolumesMetadataTest-1949166450 None] Lock "cinder-c8c6e563-2414-422b-9a58-db86507207ae-delete_volume" released by "delete_volume" :: held 3.863s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Flow 'volume_create_manager' (d3ac1870-a124-470d-afd9-b301782f11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d6a93-b50a-408e-b0a0-e5d70b441850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d6a93-b50a-408e-b0a0-e5d70b441850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-908179155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1376a65-28bb-458c-9e93-7cbfd8cde649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21233ebac034cd49b749d9aec769faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:00Z,use_quota=True,user_id='dd22fadffc914a759f243a99e3fcb4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4ba98b-042e-4028-99cb-e9dc5d9aedd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4ba98b-042e-4028-99cb-e9dc5d9aedd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e24bce8-cef3-403b-ab38-9c923bfd1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e24bce8-cef3-403b-ab38-9c923bfd1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1376a65-28bb-458c-9e93-7cbfd8cde649', 'volume_name': 'volume-e1376a65-28bb-458c-9e93-7cbfd8cde649', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990c6986-2b3a-47ab-9ff3-b8e0809f845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990c6986-2b3a-47ab-9ff3-b8e0809f845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1814329-92ff-43f3-bc2c-e742d71d5bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:20:59 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Volume e1376a65-28bb-458c-9e93-7cbfd8cde649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1376a65-28bb-458c-9e93-7cbfd8cde649', 'volume_size': 1} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-908179155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1376a65-28bb-458c-9e93-7cbfd8cde649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21233ebac034cd49b749d9aec769faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:00Z,use_quota=True,user_id='dd22fadffc914a759f243a99e3fcb4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Creating volume e1376a65-28bb-458c-9e93-7cbfd8cde649 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:20:59 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:20:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:20:59 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 1073741824 Jul 09 09:20:59 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Flow 'volume_create_manager' (1024a691-faa8-4915-99db-bb0e049158ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d4facc-3b0f-4a42-aa45-68d6ae375c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d4facc-3b0f-4a42-aa45-68d6ae375c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2082922153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13b82f0-9a4b-434d-8bf4-945640d4f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b51fdeb3d4b349d47955fd0e8fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:01Z,use_quota=True,user_id='46ae2479ba0a49d692c17c458a263e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c145bb8a-4147-404f-b448-2142b86909cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c145bb8a-4147-404f-b448-2142b86909cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6738bb39-b0ad-4ced-a8fa-25844a0d9128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6738bb39-b0ad-4ced-a8fa-25844a0d9128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13b82f0-9a4b-434d-8bf4-945640d4f2c4', 'volume_name': 'volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f055cd7b-07e4-4461-8776-d99378eefffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f055cd7b-07e4-4461-8776-d99378eefffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b0d946-a84f-44b6-97a0-6904767f8f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Volume b13b82f0-9a4b-434d-8bf4-945640d4f2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4', 'volume_size': 1} Jul 09 09:21:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:01 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 1073741824" returned: 0 in 1.140s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:01 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 Jul 09 09:21:01 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:02 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649" returned: 0 in 0.968s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2082922153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13b82f0-9a4b-434d-8bf4-945640d4f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b51fdeb3d4b349d47955fd0e8fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:01Z,use_quota=True,user_id='46ae2479ba0a49d692c17c458a263e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Creating volume b13b82f0-9a4b-434d-8bf4-945640d4f2c4 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:02 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1814329-92ff-43f3-bc2c-e742d71d5bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1376a65-28bb-458c-9e93-7cbfd8cde649', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:02 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 1073741824 Jul 09 09:21:02 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e983149a-a47a-4e5b-9b8f-bf2d01f59187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Volume volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 (e1376a65-28bb-458c-9e93-7cbfd8cde649): created successfully Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e983149a-a47a-4e5b-9b8f-bf2d01f59187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Flow 'volume_create_manager' (d3ac1870-a124-470d-afd9-b301782f11d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3828ae9d-b526-404e-9a38-a1e64ee473a3 tempest-AbsoluteLimitsTests-1798887829 None] Created volume successfully. Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Acquiring lock "cinder-e1376a65-28bb-458c-9e93-7cbfd8cde649-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "cinder-e1376a65-28bb-458c-9e93-7cbfd8cde649-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Acquiring lock "cinder-quobyte-e1376a65-28bb-458c-9e93-7cbfd8cde649" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "cinder-quobyte-e1376a65-28bb-458c-9e93-7cbfd8cde649" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ce97a-526d-4b7b-b245-6dff89574fe0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:03 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 Jul 09 09:21:03 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:03 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 1073741824" returned: 0 in 1.619s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:03 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 Jul 09 09:21:03 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:04 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649" returned: 0 in 1.385s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:04 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649 Jul 09 09:21:05 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:05 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" returned: 0 in 1.214s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] <== create_volume: return (2901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.908s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b0d946-a84f-44b6-97a0-6904767f8f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9fe7c8-7cd6-47ac-b3b8-8ada52bf1c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:05 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Volume volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 (b13b82f0-9a4b-434d-8bf4-945640d4f2c4): created successfully Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9fe7c8-7cd6-47ac-b3b8-8ada52bf1c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Flow 'volume_create_manager' (1024a691-faa8-4915-99db-bb0e049158ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ea4b9b9f-55c2-4b67-9f41-2e7c425df688 tempest-VolumesTransfersV355Test-1574938373 None] Created volume successfully. Jul 09 09:21:05 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1376a65-28bb-458c-9e93-7cbfd8cde649" returned: 0 in 0.757s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "cinder-quobyte-e1376a65-28bb-458c-9e93-7cbfd8cde649" released by "delete_volume" :: held 2.234s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Created reservations ['a59e52ac-10a2-443d-94f0-291a0f8e76da', '934ad020-677a-4972-84f2-d6fdaa15acbf', 'a798d339-f60c-44d0-b39c-7f6c95ac63d7', 'f56358d3-f7e9-4b17-8618-e31f7deb118c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:05 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:05 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:06 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.861s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Deleted volume successfully. Jul 09 09:21:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-237fe5ba-b272-4f3f-a3f1-701110836d1f tempest-AbsoluteLimitsTests-1798887829 None] Lock "cinder-e1376a65-28bb-458c-9e93-7cbfd8cde649-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1d6d4c3d-f345-4b65-8d54-99313a77e0ff tempest-VolumesTransfersV355Test-1899836136 None] Transfer volume completed successfully. Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "cinder-b13b82f0-9a4b-434d-8bf4-945640d4f2c4-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-b13b82f0-9a4b-434d-8bf4-945640d4f2c4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=106,cinder:SELECT=67,cinder:DELETE=7,cinder:INSERT=26 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "cinder-quobyte-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-quobyte-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f204c18a-60a4-4358-a31b-879c3b9990cb]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:08 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 Jul 09 09:21:08 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:09 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" returned: 0 in 1.308s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:09 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4 Jul 09 09:21:09 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:10 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" returned: 0 in 0.907s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-quobyte-b13b82f0-9a4b-434d-8bf4-945640d4f2c4" released by "delete_volume" :: held 2.296s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=74,cinder:INSERT=16,cinder:UPDATE=93,cinder:DELETE=11 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Created reservations ['a9580856-1648-4d1a-8550-f118b085eac2', '4677c61a-3f64-4742-8e5c-93daa83df672', 'c0d2086a-dc16-4135-971e-0d0ba972556e', '4c411eea-c9e5-4505-896d-7015a69a5c82'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:11 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:11 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:11 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.869s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:11 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Deleted volume successfully. Jul 09 09:21:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4542fa97-229b-434d-a08f-82ea8b110160 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-b13b82f0-9a4b-434d-8bf4-945640d4f2c4-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Flow 'volume_create_manager' (083bb707-a31a-48a5-8f79-6beca906e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd96cfd-b17c-43c9-9f17-e4a4fab11d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd96cfd-b17c-43c9-9f17-e4a4fab11d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1806247149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01876bae-68f4-448a-a841-61e265ae7750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b51fdeb3d4b349d47955fd0e8fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:12Z,use_quota=True,user_id='46ae2479ba0a49d692c17c458a263e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daf868f-be8a-4936-bc9f-36a869d3ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daf868f-be8a-4936-bc9f-36a869d3ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b9e534-7078-4acf-b0e6-b8c66f4c204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b9e534-7078-4acf-b0e6-b8c66f4c204f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01876bae-68f4-448a-a841-61e265ae7750', 'volume_name': 'volume-01876bae-68f4-448a-a841-61e265ae7750', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50adc281-6ec0-4d35-95ae-d8c3a0aea990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50adc281-6ec0-4d35-95ae-d8c3a0aea990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981ca650-f72d-4bf1-b82b-b54c254597b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Volume 01876bae-68f4-448a-a841-61e265ae7750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01876bae-68f4-448a-a841-61e265ae7750', 'volume_size': 1} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1806247149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01876bae-68f4-448a-a841-61e265ae7750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b51fdeb3d4b349d47955fd0e8fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:12Z,use_quota=True,user_id='46ae2479ba0a49d692c17c458a263e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Creating volume 01876bae-68f4-448a-a841-61e265ae7750 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:12 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:12 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 1073741824 Jul 09 09:21:12 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:13 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 1073741824" returned: 0 in 1.200s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:13 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 Jul 09 09:21:13 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:14 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750" returned: 0 in 0.791s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981ca650-f72d-4bf1-b82b-b54c254597b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01876bae-68f4-448a-a841-61e265ae7750', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68391e1f-d1a3-4c2a-a383-b51aed1846e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Volume volume-01876bae-68f4-448a-a841-61e265ae7750 (01876bae-68f4-448a-a841-61e265ae7750): created successfully Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68391e1f-d1a3-4c2a-a383-b51aed1846e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Flow 'volume_create_manager' (083bb707-a31a-48a5-8f79-6beca906e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-96412a1f-140d-4c2e-ba50-0f27b702d154 tempest-VolumesTransfersV355Test-1574938373 None] Created volume successfully. Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Flow 'volume_create_manager' (6268e7ae-ff6e-4090-a225-d236d29ca19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76ae1b9-7e44-426b-8cfc-aa01ca4e6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76ae1b9-7e44-426b-8cfc-aa01ca4e6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-333920441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9396fa0ddc31454aa838974ee3b73541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:15Z,use_quota=True,user_id='da66557a95024443a684b64f66ca2841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b2af2d-fec3-4d0b-a1dc-d65600db25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b2af2d-fec3-4d0b-a1dc-d65600db25ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a49140-44bf-41e5-87f0-a31e22c69024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a49140-44bf-41e5-87f0-a31e22c69024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c', 'volume_name': 'volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4725b5-ddcc-40ff-81a1-29e179095313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4725b5-ddcc-40ff-81a1-29e179095313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10363ab-228b-45b9-b5e4-9491b2ea4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Volume 51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c', 'volume_size': 1} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-333920441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9396fa0ddc31454aa838974ee3b73541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:15Z,use_quota=True,user_id='da66557a95024443a684b64f66ca2841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Creating volume 51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:14 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:15 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c 1073741824 Jul 09 09:21:15 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:15 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c 1073741824" returned: 0 in 1.028s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:16 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c Jul 09 09:21:16 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "cinder-01876bae-68f4-448a-a841-61e265ae7750-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-01876bae-68f4-448a-a841-61e265ae7750-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "cinder-quobyte-01876bae-68f4-448a-a841-61e265ae7750" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-quobyte-01876bae-68f4-448a-a841-61e265ae7750" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b7667-bc17-4ee8-b381-fb659f4e29a4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:16 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 Jul 09 09:21:16 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:16 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" returned: 0 in 0.825s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10363ab-228b-45b9-b5e4-9491b2ea4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfd60a0-bbad-45fe-b5f5-6c7acffac2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Volume volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c (51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c): created successfully Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfd60a0-bbad-45fe-b5f5-6c7acffac2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Flow 'volume_create_manager' (6268e7ae-ff6e-4090-a225-d236d29ca19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cc0e9a77-845b-4e51-976d-2d0e1d44b093 tempest-VolumesTransfersTest-241920988 None] Created volume successfully. Jul 09 09:21:17 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750" returned: 0 in 0.880s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:17 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750 Jul 09 09:21:17 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:17 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-01876bae-68f4-448a-a841-61e265ae7750" returned: 0 in 0.655s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-quobyte-01876bae-68f4-448a-a841-61e265ae7750" released by "delete_volume" :: held 1.575s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Created reservations ['4f29cbfb-b3d1-44f2-b485-4c9ab175b492', '8b478a39-a2d8-43e5-9bd9-101562fc5f96', '39ad5ce1-8cea-4d1b-bd9e-34f74afa5e34', '2e9d3c7d-4aac-47bf-9c59-e630fdc422e8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:18 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:18 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2ac2fd46-a10d-441c-a04d-01b0223b7282 tempest-VolumesTransfersTest-172842915 None] Transfer volume completed successfully. Jul 09 09:21:18 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.689s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Deleted volume successfully. Jul 09 09:21:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-815b1443-5b9e-4dfb-a5b1-383fb8550687 tempest-VolumesTransfersV355Test-1415303373 None] Lock "cinder-01876bae-68f4-448a-a841-61e265ae7750-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "cinder-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "cinder-quobyte-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-quobyte-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac371437-0537-4baf-ae34-cd1181c024cc]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:19 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c Jul 09 09:21:19 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:20 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" returned: 0 in 0.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:20 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c Jul 09 09:21:20 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:21 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" returned: 0 in 0.707s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-quobyte-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c" released by "delete_volume" :: held 1.632s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Created reservations ['28ecba92-d0a1-454c-9226-6bb14115082d', 'cfddd0d2-9148-4303-95d9-ee87f398c934', 'c3bf38e1-4acf-466a-8227-c3c114f8de94', 'd3a0460e-db57-4020-b4e1-f6768d763678'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:21 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:21 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:22 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Deleted volume successfully. Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cab7f6d0-c138-4e9a-bef9-15132918ab51 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-51d605b6-4a1c-4e2d-9cdd-0d7d4fcb3a7c-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Flow 'volume_create_manager' (bc7e23b2-b541-475b-9cbe-a4fc408e6a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e786bd0-efb8-4e7c-8731-38f38715dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e786bd0-efb8-4e7c-8731-38f38715dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512721789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27625da9-730e-4ff1-b8ad-de2e1ebc81b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9396fa0ddc31454aa838974ee3b73541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:23Z,use_quota=True,user_id='da66557a95024443a684b64f66ca2841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77292fd5-15f7-4c36-b128-88a15a7cc5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77292fd5-15f7-4c36-b128-88a15a7cc5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4527c7b5-6840-4811-9205-10c6f1fdf23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4527c7b5-6840-4811-9205-10c6f1fdf23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27625da9-730e-4ff1-b8ad-de2e1ebc81b7', 'volume_name': 'volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282d913f-21fc-4cd6-80e2-957973e4bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282d913f-21fc-4cd6-80e2-957973e4bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae8a0f1-eb85-4496-a11b-031a62260c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Volume 27625da9-730e-4ff1-b8ad-de2e1ebc81b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7', 'volume_size': 1} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512721789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27625da9-730e-4ff1-b8ad-de2e1ebc81b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9396fa0ddc31454aa838974ee3b73541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:23Z,use_quota=True,user_id='da66557a95024443a684b64f66ca2841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Creating volume 27625da9-730e-4ff1-b8ad-de2e1ebc81b7 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:22 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 1073741824 Jul 09 09:21:22 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:23 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 1073741824" returned: 0 in 0.947s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:23 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 Jul 09 09:21:23 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (a7dc0c70-9336-4b13-99b1-eff5918ee3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e5fedf-74e0-4199-b2f9-6db6e4026386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e5fedf-74e0-4199-b2f9-6db6e4026386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-170779780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b44739-8861-44ec-91f7-db4d45cbd115,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:24Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204a1ff-a32d-4399-9db7-ddf330f9b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204a1ff-a32d-4399-9db7-ddf330f9b22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d53bfea-ea60-4d42-87e5-ebbc1a7f9bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d53bfea-ea60-4d42-87e5-ebbc1a7f9bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b44739-8861-44ec-91f7-db4d45cbd115', 'volume_name': 'volume-b2b44739-8861-44ec-91f7-db4d45cbd115', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd65522-1b77-481f-ba7c-fe3c458bd2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd65522-1b77-481f-ba7c-fe3c458bd2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d44c25-f6e4-4241-b556-2a6e762e5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Volume b2b44739-8861-44ec-91f7-db4d45cbd115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b44739-8861-44ec-91f7-db4d45cbd115', 'volume_size': 1} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:24 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" returned: 0 in 0.760s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-170779780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b44739-8861-44ec-91f7-db4d45cbd115,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:24Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Creating volume b2b44739-8861-44ec-91f7-db4d45cbd115 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae8a0f1-eb85-4496-a11b-031a62260c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 1073741824 Jul 09 09:21:24 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7252688-f72b-45cd-b47b-c641fd8a785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Volume volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 (27625da9-730e-4ff1-b8ad-de2e1ebc81b7): created successfully Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7252688-f72b-45cd-b47b-c641fd8a785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Flow 'volume_create_manager' (bc7e23b2-b541-475b-9cbe-a4fc408e6a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-df52e83d-506f-4db5-add6-c803f513e673 tempest-VolumesTransfersTest-241920988 None] Created volume successfully. Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "cinder-27625da9-730e-4ff1-b8ad-de2e1ebc81b7-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-27625da9-730e-4ff1-b8ad-de2e1ebc81b7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "cinder-quobyte-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-quobyte-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0f642-a2cb-41cc-8f92-a21050fb2753]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:25 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 Jul 09 09:21:25 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:25 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 1073741824" returned: 0 in 1.078s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:25 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 Jul 09 09:21:25 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:26 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" returned: 0 in 0.874s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:26 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7 Jul 09 09:21:26 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:26 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d44c25-f6e4-4241-b556-2a6e762e5f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b44739-8861-44ec-91f7-db4d45cbd115', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5973e8f8-1c00-4bdc-8874-5ea0554380d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Volume volume-b2b44739-8861-44ec-91f7-db4d45cbd115 (b2b44739-8861-44ec-91f7-db4d45cbd115): created successfully Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5973e8f8-1c00-4bdc-8874-5ea0554380d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (a7dc0c70-9336-4b13-99b1-eff5918ee3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:26 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-41e94ae0-cc02-4184-83cf-ba61ec8ada22 tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:21:26 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" returned: 0 in 0.658s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-quobyte-27625da9-730e-4ff1-b8ad-de2e1ebc81b7" released by "delete_volume" :: held 1.582s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Created reservations ['cdaacab5-ab95-4340-be00-f20c0e0ebc70', 'e51cce8b-03ee-408a-9cf5-0d1ec09996d2', '8c6e17ed-f3b3-4dfe-bacc-f8174ab25f0c', '691099a4-f186-4371-80f9-f3250ed42aed'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:26 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:26 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (28afe232-f402-40d1-9154-a7269e66baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867eac26-bb2a-4f58-918d-c30d5877213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867eac26-bb2a-4f58-918d-c30d5877213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916632868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d08f08-b0b6-41cf-8b5f-7ee76e89e023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:27Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f59789e-99d0-4139-8c68-4d3fc9d01d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f59789e-99d0-4139-8c68-4d3fc9d01d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9416618e-e20f-41f1-bd11-fc0ba441827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9416618e-e20f-41f1-bd11-fc0ba441827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d08f08-b0b6-41cf-8b5f-7ee76e89e023', 'volume_name': 'volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5458d953-28bf-4595-b2af-854765ddeb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5458d953-28bf-4595-b2af-854765ddeb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b974461-4377-4cce-8978-ba43b4f6717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:27 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Volume 93d08f08-b0b6-41cf-8b5f-7ee76e89e023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023', 'volume_size': 1} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916632868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d08f08-b0b6-41cf-8b5f-7ee76e89e023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:27Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Creating volume 93d08f08-b0b6-41cf-8b5f-7ee76e89e023 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:27 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:27 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.740s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:27 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 1073741824 Jul 09 09:21:27 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Deleted volume successfully. Jul 09 09:21:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-454216e0-72cf-4c8c-a04d-24a7a5a265c8 tempest-VolumesTransfersTest-1623469096 None] Lock "cinder-27625da9-730e-4ff1-b8ad-de2e1ebc81b7-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (6fc6c8a2-87e8-48bc-9e08-da364d16ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef7e062-002c-44f9-b3da-330ffe5381d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef7e062-002c-44f9-b3da-330ffe5381d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727549600',display_name='tempest-VolumesGetTest-Volume-1350150535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62502939-e0db-4743-bec5-6ec7bfb35a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:28Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35917dbc-073e-4b68-88a1-5c376c9555fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35917dbc-073e-4b68-88a1-5c376c9555fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21626bf-c040-49e9-9a18-520122fae413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21626bf-c040-49e9-9a18-520122fae413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62502939-e0db-4743-bec5-6ec7bfb35a86', 'volume_name': 'volume-62502939-e0db-4743-bec5-6ec7bfb35a86', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02084d33-d919-426a-9e0e-aa5d4e8d376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02084d33-d919-426a-9e0e-aa5d4e8d376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c774f6fb-163a-4311-9e9f-1d9d7d56eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Volume 62502939-e0db-4743-bec5-6ec7bfb35a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62502939-e0db-4743-bec5-6ec7bfb35a86', 'volume_size': 1} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:28 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 1073741824" returned: 0 in 0.901s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:28 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 Jul 09 09:21:28 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:29 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" returned: 0 in 0.691s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-727549600',display_name='tempest-VolumesGetTest-Volume-1350150535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62502939-e0db-4743-bec5-6ec7bfb35a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:28Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Creating volume 62502939-e0db-4743-bec5-6ec7bfb35a86 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:29 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:29 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 1073741824 Jul 09 09:21:29 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b974461-4377-4cce-8978-ba43b4f6717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479fa9e-0f8f-4a39-89ca-1f3cc2de4fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:29 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Volume volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 (93d08f08-b0b6-41cf-8b5f-7ee76e89e023): created successfully Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479fa9e-0f8f-4a39-89ca-1f3cc2de4fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (28afe232-f402-40d1-9154-a7269e66baad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1b78192c-538d-444b-856c-afa678bcaeb4 tempest-AttachVolumeTestJSON-1898156594 None] Created volume successfully. Jul 09 09:21:30 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 1073741824" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:30 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 Jul 09 09:21:30 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:30 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86" returned: 0 in 0.661s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c774f6fb-163a-4311-9e9f-1d9d7d56eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62502939-e0db-4743-bec5-6ec7bfb35a86', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afaea1a-c6b0-45cb-ac46-142916b24acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:30 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Volume volume-62502939-e0db-4743-bec5-6ec7bfb35a86 (62502939-e0db-4743-bec5-6ec7bfb35a86): created successfully Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afaea1a-c6b0-45cb-ac46-142916b24acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (6fc6c8a2-87e8-48bc-9e08-da364d16ff29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bf76e0ed-60f7-4dac-a418-8bc14b009a21 tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-62502939-e0db-4743-bec5-6ec7bfb35a86-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "cinder-62502939-e0db-4743-bec5-6ec7bfb35a86-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-62502939-e0db-4743-bec5-6ec7bfb35a86" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-62502939-e0db-4743-bec5-6ec7bfb35a86" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6d1ea-6967-4be8-ba64-0ea38f33283e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:31 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 Jul 09 09:21:31 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:32 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86" returned: 0 in 0.822s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:32 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86 Jul 09 09:21:32 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[646491e0-b851-4c22-8e07-453c99f65ac2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:32 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 Jul 09 09:21:32 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:33 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-62502939-e0db-4743-bec5-6ec7bfb35a86" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-62502939-e0db-4743-bec5-6ec7bfb35a86" released by "delete_volume" :: held 1.627s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Created reservations ['ba8961c5-1cee-4420-ab8b-fcf8ae9d7404', 'addbad1e-bfd3-47b8-8b63-74e0a6413cf5', 'b497f035-6745-4099-9619-066cb9e45266', '746421ca-e5fc-4498-bc4e-b699d66a2cce'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:33 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:33 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:33 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" returned: 0 in 0.857s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff740a4c-2267-4301-8f24-ce7594749c9d', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:21:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-6ee78659-e6e9-4291-a8a8-42683dba4c9a req-885a11ea-0934-47a4-8e1c-c99807de596d tempest-AttachVolumeTestJSON-1898156594 None] attachment_update completed successfully. Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-b2b44739-8861-44ec-91f7-db4d45cbd115-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "cinder-b2b44739-8861-44ec-91f7-db4d45cbd115-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-b2b44739-8861-44ec-91f7-db4d45cbd115" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-b2b44739-8861-44ec-91f7-db4d45cbd115" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc5b6c-1b72-4467-9e70-ac252644e3fd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:34 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a6d79938-05b8-4c40-a8af-ba205498c7e1 tempest-VolumesGetTest-440885248 None] Lock "cinder-62502939-e0db-4743-bec5-6ec7bfb35a86-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:34 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 Jul 09 09:21:34 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:34 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115" returned: 0 in 0.822s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:34 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115 Jul 09 09:21:34 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:35 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b2b44739-8861-44ec-91f7-db4d45cbd115" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-b2b44739-8861-44ec-91f7-db4d45cbd115" released by "delete_volume" :: held 1.566s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Created reservations ['541c6dd3-afe5-4ac7-b793-5678298a1e71', '9866b978-04c0-456d-a33b-a172aeb1e685', '7d9b728c-a36b-4001-bcb6-a92facacfa81', 'd000557b-fe33-4be9-b7fc-13390e83bc26'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:35 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:35 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:36 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.690s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0ebd05fb-dc42-40b5-bfad-787aee44459a tempest-VolumesGetTest-440885248 None] Lock "cinder-b2b44739-8861-44ec-91f7-db4d45cbd115-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (b91502b4-6484-4569-80c7-6a7d2a2b5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfbc73f-2b81-4dd4-9010-5f6f8c9ca41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfbc73f-2b81-4dd4-9010-5f6f8c9ca41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690677072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34b283f-701d-49c4-9b4e-95d0dde87670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef967df6-afd2-4615-b21d-2e2277d349c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef967df6-afd2-4615-b21d-2e2277d349c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19470d3d-7dd2-4f56-a9a7-d199ef3e3f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19470d3d-7dd2-4f56-a9a7-d199ef3e3f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34b283f-701d-49c4-9b4e-95d0dde87670', 'volume_name': 'volume-f34b283f-701d-49c4-9b4e-95d0dde87670', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b16e8b3-242b-45f9-b54d-e26aa44320a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b16e8b3-242b-45f9-b54d-e26aa44320a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d05366-f898-476a-bb77-08457cc53c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:36 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Volume f34b283f-701d-49c4-9b4e-95d0dde87670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34b283f-701d-49c4-9b4e-95d0dde87670', 'volume_size': 1} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690677072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34b283f-701d-49c4-9b4e-95d0dde87670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Creating volume f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:36 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:36 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 1073741824 Jul 09 09:21:36 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:37 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 1073741824" returned: 0 in 1.009s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:37 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:21:37 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:38 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.668s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d05366-f898-476a-bb77-08457cc53c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34b283f-701d-49c4-9b4e-95d0dde87670', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64b4d6f-70e1-4bfd-8800-ddcc30d4cc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Volume volume-f34b283f-701d-49c4-9b4e-95d0dde87670 (f34b283f-701d-49c4-9b4e-95d0dde87670): created successfully Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64b4d6f-70e1-4bfd-8800-ddcc30d4cc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (b91502b4-6484-4569-80c7-6a7d2a2b5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-141c9b04-f7be-4edd-8816-c4513bafac8d tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (a1c88340-ddfd-4463-8c9a-c87f2727db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50334e08-78bd-4f5d-a000-f83c76a8f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50334e08-78bd-4f5d-a000-f83c76a8f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2134283690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732782fb-fce3-478b-b8de-4396cef96a74,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f34b283f-701d-49c4-9b4e-95d0dde87670,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:39Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fea33-313b-43e5-985c-4a120d01cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fea33-313b-43e5-985c-4a120d01cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09125733-87c4-4a07-9175-f40e06528e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09125733-87c4-4a07-9175-f40e06528e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '732782fb-fce3-478b-b8de-4396cef96a74', 'volume_name': 'volume-732782fb-fce3-478b-b8de-4396cef96a74', 'volume_size': 1, 'source_volid': 'f34b283f-701d-49c4-9b4e-95d0dde87670', 'source_volstatus': 'available'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17f8d2f-1d08-4de9-a2af-e02ca21a5a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17f8d2f-1d08-4de9-a2af-e02ca21a5a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80575951-9450-4617-ba21-fcfcc3255469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Volume 732782fb-fce3-478b-b8de-4396cef96a74: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-732782fb-fce3-478b-b8de-4396cef96a74', 'volume_size': 1, 'source_volid': 'f34b283f-701d-49c4-9b4e-95d0dde87670', 'source_volstatus': 'available'} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:39 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Cloning volume f34b283f-701d-49c4-9b4e-95d0dde87670 to volume 732782fb-fce3-478b-b8de-4396cef96a74 Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Creating offline snapshot 933f7af2-6c03-4ce2-9ca6-b6878669c0d0 of volume f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd13f44f-b5c4-43ce-ac05-8b26caf3b095]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (3de9b7e6-7f82-4a3f-bc62-10dea65076ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fac73ba-6e7c-477a-8794-7122cca57eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fac73ba-6e7c-477a-8794-7122cca57eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1942363330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959f5854-7ecd-446a-a2a4-bc3f667f2832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:40Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f46080e-851a-44a9-a1d3-5120e272b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f46080e-851a-44a9-a1d3-5120e272b845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf3c0f1-15e9-4280-a8ea-1f01f1f6bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf3c0f1-15e9-4280-a8ea-1f01f1f6bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959f5854-7ecd-446a-a2a4-bc3f667f2832', 'volume_name': 'volume-959f5854-7ecd-446a-a2a4-bc3f667f2832', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf081d6-8f1c-480f-8c09-8c6cfde0bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf081d6-8f1c-480f-8c09-8c6cfde0bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20565fbe-9c4a-402a-b872-3370fbaa84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Volume 959f5854-7ecd-446a-a2a4-bc3f667f2832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959f5854-7ecd-446a-a2a4-bc3f667f2832', 'volume_size': 1} Jul 09 09:21:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:40 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:21:40 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:40 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.993s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:40 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 1G Jul 09 09:21:40 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:41 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 1G" returned: 0 in 1.069s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34b283f-701d-49c4-9b4e-95d0dde87670 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:41 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34b283f-701d-49c4-9b4e-95d0dde87670 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:41 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Flow 'volume_create_manager' (d4e289bc-8bd7-4f8f-836b-d5ba920700fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53588351-1afd-4867-a6f2-3c9605ce051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53588351-1afd-4867-a6f2-3c9605ce051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048101016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741a7e11-98cb-4c6a-a07d-630a8563a600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55687111a34499dbfea17d282983b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:42Z,use_quota=True,user_id='3f69cda0386544d6b17f9592f15d43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a038134f-646f-48bb-a9d2-304d41099735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a038134f-646f-48bb-a9d2-304d41099735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd9674b-8634-4875-836d-7b52e2f4490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd9674b-8634-4875-836d-7b52e2f4490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741a7e11-98cb-4c6a-a07d-630a8563a600', 'volume_name': 'volume-741a7e11-98cb-4c6a-a07d-630a8563a600', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998b6476-ad38-4627-8a83-9557d1a3ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998b6476-ad38-4627-8a83-9557d1a3ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e560f1b1-f0b6-4e48-949c-169f77b201f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Volume 741a7e11-98cb-4c6a-a07d-630a8563a600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741a7e11-98cb-4c6a-a07d-630a8563a600', 'volume_size': 1} Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:42 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34b283f-701d-49c4-9b4e-95d0dde87670 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.821s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:42 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 is being set with open permissions: ugo+rw Jul 09 09:21:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:42 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:42 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:43 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.686s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:43 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info Jul 09 09:21:43 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:44 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info" returned: 0 in 0.664s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:44 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info is being set with open permissions: ugo+rw Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:44 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info Jul 09 09:21:44 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:44 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.info" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] snapshot: 933f7af2-6c03-4ce2-9ca6-b6878669c0d0, volume: 732782fb-fce3-478b-b8de-4396cef96a74, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a963b-3aa8-4ea3-a121-88263c074e9e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:44 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:44 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:45 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.786s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34b283f-701d-49c4-9b4e-95d0dde87670(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98626c1-b11f-4967-adbc-2ff94b1c0c10]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:45 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:21:45 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:46 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.773s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:46 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:21:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:46 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 Jul 09 09:21:46 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Acquiring lock "cinder-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "cinder-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Acquiring lock "cinder-quobyte-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "cinder-quobyte-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22488b1-8da6-4b94-8077-77aa98e352f4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:50 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 Jul 09 09:21:50 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:50 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:50 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:51 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" returned: 0 in 1.600s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:51 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2 Jul 09 09:21:51 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:51 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74" returned: 0 in 5.494s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb26b49-3b98-4aa6-b0ac-27a0d2714646]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:51 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:51 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:21:51 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.467s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 8 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:21:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:21:52 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" returned: 0 in 0.769s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "cinder-quobyte-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2" released by "delete_volume" :: held 2.464s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Created reservations ['cc2dc41a-65f7-438b-bdef-768db1ab0c15', '7e591e89-d165-496a-864f-67f3e67d3d29', 'c91b5236-ede2-4e46-a2af-ce8fc4f9c9ec', 'a580a967-f019-4a18-bf24-6bb9a3a36747'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:52 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:21:52 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:52 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.955s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:21:52 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Converted 1024.00 MB image at 186.34 MB/s Jul 09 09:21:52 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 is being set with open permissions: ugo+rw Jul 09 09:21:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:52 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 Jul 09 09:21:52 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:53 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.660s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:21:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Deleted volume successfully. Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9bccb540-eeff-442b-8cca-870a5ad30b94 tempest-AttachVolumeShelveTestJSON-758486397 None] Lock "cinder-36200221-97f8-4fcb-a9f1-7c8fbabb2dd2-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:53 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74" returned: 0 in 0.678s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" released by "_copy_volume_from_snapshot" :: held 8.761s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-933f7af2-6c03-4ce2-9ca6-b6878669c0d0" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-933f7af2-6c03-4ce2-9ca6-b6878669c0d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Deleting offline snapshot 933f7af2-6c03-4ce2-9ca6-b6878669c0d0 of volume f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] snapshot_file for this snap is: volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce31c96-acbc-4142-8379-393ddc0b3337]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:53 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:53 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:54 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.793s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34b283f-701d-49c4-9b4e-95d0dde87670(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:21:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ff9e7-ea4b-4f70-a86b-542cbad1c519]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:21:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:54 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:21:54 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:55 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.811s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:55 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:55 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:56 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.808s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:56 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0 Jul 09 09:21:56 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:56 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670.933f7af2-6c03-4ce2-9ca6-b6878669c0d0" returned: 0 in 0.704s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-933f7af2-6c03-4ce2-9ca6-b6878669c0d0" released by "_delete_snapshot" :: held 3.217s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.067s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.799s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1942363330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959f5854-7ecd-446a-a2a4-bc3f667f2832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898e550a25284a79b88d348f84115d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:40Z,use_quota=True,user_id='9b748373f5cc4fb6ac9622eaf388a4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Creating volume 959f5854-7ecd-446a-a2a4-bc3f667f2832 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:56 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:56 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 1073741824 Jul 09 09:21:56 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80575951-9450-4617-ba21-fcfcc3255469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732782fb-fce3-478b-b8de-4396cef96a74', 'volume_size': 1, 'source_volid': 'f34b283f-701d-49c4-9b4e-95d0dde87670', 'source_volstatus': 'available'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95ff24e-3317-40cb-99fc-24439fecc941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Volume volume-732782fb-fce3-478b-b8de-4396cef96a74 (732782fb-fce3-478b-b8de-4396cef96a74): created successfully Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95ff24e-3317-40cb-99fc-24439fecc941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (a1c88340-ddfd-4463-8c9a-c87f2727db15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:56 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-34907290-3206-4796-8f1f-5e25fef89717 tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:21:57 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 1073741824" returned: 0 in 1.109s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (177f1192-05a2-4d62-9cf3-c9b2a2848326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a60cb3a-59c7-46f0-b2ae-aa2dbc141bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a60cb3a-59c7-46f0-b2ae-aa2dbc141bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124835953',display_name='tempest-VolumesGetTest-Volume-84339657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10af4e9b-da1d-429a-9f40-26cdba600d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:58Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f46d99-7c0d-4d96-829d-d2c66a223848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f46d99-7c0d-4d96-829d-d2c66a223848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eddea70-16a1-40e5-873f-fba40b7d3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eddea70-16a1-40e5-873f-fba40b7d3518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10af4e9b-da1d-429a-9f40-26cdba600d34', 'volume_name': 'volume-10af4e9b-da1d-429a-9f40-26cdba600d34', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ee99b-2373-4604-a202-9ccb0e55f2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ee99b-2373-4604-a202-9ccb0e55f2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19a6a65-dc72-44e3-8882-e84f435031b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:58 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Volume 10af4e9b-da1d-429a-9f40-26cdba600d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10af4e9b-da1d-429a-9f40-26cdba600d34', 'volume_size': 1} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:58 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 Jul 09 09:21:58 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:58 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832" returned: 0 in 0.682s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.152s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1048101016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741a7e11-98cb-4c6a-a07d-630a8563a600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55687111a34499dbfea17d282983b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:42Z,use_quota=True,user_id='3f69cda0386544d6b17f9592f15d43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Creating volume 741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:21:58 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:58 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 1073741824 Jul 09 09:21:58 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20565fbe-9c4a-402a-b872-3370fbaa84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959f5854-7ecd-446a-a2a4-bc3f667f2832', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8b52e-b30a-4585-80ca-07f1bc182329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:21:58 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Volume volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 (959f5854-7ecd-446a-a2a4-bc3f667f2832): created successfully Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8b52e-b30a-4585-80ca-07f1bc182329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:21:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Flow 'volume_create_manager' (3de9b7e6-7f82-4a3f-bc62-10dea65076ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:21:58 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a60e4a28-5be3-4aa3-9107-fef5634c5c2d tempest-AttachVolumeTestJSON-1898156594 None] Created volume successfully. Jul 09 09:21:59 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 09 09:21:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 1073741824" returned: 0 in 0.904s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:21:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:21:59 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:21:59 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:00 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.720s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:21:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2124835953',display_name='tempest-VolumesGetTest-Volume-84339657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10af4e9b-da1d-429a-9f40-26cdba600d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:58Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Creating volume 10af4e9b-da1d-429a-9f40-26cdba600d34 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:00 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e560f1b1-f0b6-4e48-949c-169f77b201f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741a7e11-98cb-4c6a-a07d-630a8563a600', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:00 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 1073741824 Jul 09 09:22:00 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51bafa-18d3-4938-9a21-b875a5d6f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Volume volume-741a7e11-98cb-4c6a-a07d-630a8563a600 (741a7e11-98cb-4c6a-a07d-630a8563a600): created successfully Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51bafa-18d3-4938-9a21-b875a5d6f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Flow 'volume_create_manager' (d4e289bc-8bd7-4f8f-836b-d5ba920700fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7e65e7d0-6518-4980-84e4-5c2512c6d89f tempest-VolumesActionsTest-1367464851 None] Created volume successfully. Jul 09 09:22:01 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 1073741824" returned: 0 in 1.045s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:01 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 Jul 09 09:22:01 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:02 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19a6a65-dc72-44e3-8882-e84f435031b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10af4e9b-da1d-429a-9f40-26cdba600d34', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f86a71-238b-4260-91e6-0ac67b86249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Volume volume-10af4e9b-da1d-429a-9f40-26cdba600d34 (10af4e9b-da1d-429a-9f40-26cdba600d34): created successfully Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f86a71-238b-4260-91e6-0ac67b86249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (177f1192-05a2-4d62-9cf3-c9b2a2848326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-764951d1-dce1-4b41-8cef-17047e03ece9 tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd08ff06-34b1-4770-896d-b0a227850ad0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:02 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 Jul 09 09:22:02 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-10af4e9b-da1d-429a-9f40-26cdba600d34-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "cinder-10af4e9b-da1d-429a-9f40-26cdba600d34-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-10af4e9b-da1d-429a-9f40-26cdba600d34" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-10af4e9b-da1d-429a-9f40-26cdba600d34" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e664fe9-2204-4a81-aaab-0c4963e81fbd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:03 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832" returned: 0 in 0.966s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.992s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:03 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 Jul 09 09:22:03 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:03 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-959f5854-7ecd-446a-a2a4-bc3f667f2832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b636d9d0-8df3-4414-86b6-d95b44eeaa1b', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:22:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-82f73d99-7daf-4cd9-a1be-37e81084a897 req-37fa05ed-05e9-4d4a-b8be-e41760e11213 tempest-AttachVolumeTestJSON-1898156594 None] attachment_update completed successfully. Jul 09 09:22:04 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34" returned: 0 in 0.845s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:04 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34 Jul 09 09:22:04 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:05 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-10af4e9b-da1d-429a-9f40-26cdba600d34" returned: 0 in 0.850s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-10af4e9b-da1d-429a-9f40-26cdba600d34" released by "delete_volume" :: held 1.760s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Created reservations ['0adb9a35-5d0a-40a9-827d-c8cd0256c3de', '4dfbfa8f-f744-491d-9452-9fb1d6240a79', 'ed8b52fa-4ea3-4619-9cac-73182f129f1c', 'ba65a656-046b-47cc-9361-b28f9488892b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:05 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:05 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-732782fb-fce3-478b-b8de-4396cef96a74-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "cinder-732782fb-fce3-478b-b8de-4396cef96a74-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bcc59b-c645-44dc-9736-699ec48d0d13]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:06 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 Jul 09 09:22:06 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:06 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.913s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:22:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d748dfb2-5d88-4e51-8e02-1ceff2265a0c tempest-VolumesGetTest-440885248 None] Lock "cinder-10af4e9b-da1d-429a-9f40-26cdba600d34-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:07 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74" returned: 0 in 0.997s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:07 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74 Jul 09 09:22:07 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:08 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-732782fb-fce3-478b-b8de-4396cef96a74" returned: 0 in 0.876s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-732782fb-fce3-478b-b8de-4396cef96a74" released by "delete_volume" :: held 1.945s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Created reservations ['e4de3db7-d5cf-4067-bfc9-58439434430f', 'e87d4c08-5528-4e93-a815-469183bdcf51', 'f63d288a-3b63-4327-9aa7-e7bff2522f1a', '605aae78-9725-4c79-a3e5-f8ab6c9bf53d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:08 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:08 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-f34b283f-701d-49c4-9b4e-95d0dde87670-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "cinder-f34b283f-701d-49c4-9b4e-95d0dde87670-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=82,cinder:INSERT=28,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-f34b283f-701d-49c4-9b4e-95d0dde87670" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-f34b283f-701d-49c4-9b4e-95d0dde87670" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b550c-cf6f-496c-ae4a-044780336884]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:08 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:22:08 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:09 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.379s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:09 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:22:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2313717f-f8b3-45fd-8c6f-5a276fdf70e2 tempest-VolumesGetTest-440885248 None] Lock "cinder-732782fb-fce3-478b-b8de-4396cef96a74-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:10 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 1.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:10 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670 Jul 09 09:22:10 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-3286ace3-5186-45b8-846c-a340eaf4b30d req-40e6f085-7c5f-47e3-93ba-2949b7928974 tempest-AttachVolumeTestJSON-1898156594 None] Terminate volume connection completed successfully. Jul 09 09:22:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-3286ace3-5186-45b8-846c-a340eaf4b30d req-40e6f085-7c5f-47e3-93ba-2949b7928974 tempest-AttachVolumeTestJSON-1898156594 None] Deleting attachment ff740a4c-2267-4301-8f24-ce7594749c9d. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:22:11 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f34b283f-701d-49c4-9b4e-95d0dde87670" returned: 0 in 0.811s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-f34b283f-701d-49c4-9b4e-95d0dde87670" released by "delete_volume" :: held 2.630s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=117,cinder:SELECT=81,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Created reservations ['9790aaee-8f98-45d3-b610-ffa2f18371f5', '7794657c-48e6-477e-94b6-7afb81cd1e33', 'f2ca79d2-b2ab-4c23-8a42-fdaf4db1e930', '14c49871-fcb0-4ac8-a6b2-b974ca373970'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:11 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:11 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:12 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.840s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:12 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:22:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-182e8899-d640-4edd-a80a-8edbc6614e61 tempest-VolumesGetTest-440885248 None] Lock "cinder-f34b283f-701d-49c4-9b4e-95d0dde87670-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a7833508-5d15-4ab5-9ece-9fbd6a7f00e7 req-5994876e-75a3-4de7-be9b-87735356b495 tempest-AttachVolumeTestJSON-1898156594 None] Terminate volume connection completed successfully. Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a7833508-5d15-4ab5-9ece-9fbd6a7f00e7 req-5994876e-75a3-4de7-be9b-87735356b495 tempest-AttachVolumeTestJSON-1898156594 None] Deleting attachment b636d9d0-8df3-4414-86b6-d95b44eeaa1b. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (5382e3c4-6654-44ab-86db-77f129df08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6fe28c-639e-4770-9f66-ff31432eee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6fe28c-639e-4770-9f66-ff31432eee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239806507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d209f7-e797-4a29-a23c-ed03ba4f0db0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:13Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c28e3e-75db-4b0d-9942-cb85680e2f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c28e3e-75db-4b0d-9942-cb85680e2f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e8ec5-205e-4617-a72f-d1774c8002fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e8ec5-205e-4617-a72f-d1774c8002fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59d209f7-e797-4a29-a23c-ed03ba4f0db0', 'volume_name': 'volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e0e744-3a0a-4c5f-9233-cb9be32851f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e0e744-3a0a-4c5f-9233-cb9be32851f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f8f4d2-e7be-4249-a262-348306e3f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:13 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 09:22:13 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Trying to clone 59d209f7-e797-4a29-a23c-ed03ba4f0db0 from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:22:14 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Image download 20.69 MB at 20.69 MB/s Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[16769532-5fa4-4b03-9bc4-d3e99d0d8e74]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:14 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD Jul 09 09:22:14 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:14 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 is fetched for user 2274e6538e74487c99d4fc4e31424261. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc27283-c2ff-4ade-83c8-d3f2576cd5ac]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:15 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD Jul 09 09:22:15 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:16 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD" returned: 0 in 1.211s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239806507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d209f7-e797-4a29-a23c-ed03ba4f0db0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:13Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Creating volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:16 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:16 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1073741824 Jul 09 09:22:16 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:17 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1073741824" returned: 0 in 0.925s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:17 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:17 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:17 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 0 in 0.785s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:18 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Attempting download of 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:22:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a547dca-d74f-4840-9156-9f944b865d12]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:18 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh Jul 09 09:22:18 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:19 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh" returned: 0 in 1.230s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:19 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh Jul 09 09:22:19 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:21 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-13ab8f98-992b-48fb-9337-22be228707d5 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" by "attach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh" returned: 1 in 1.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_pdzrkdhh' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[452dbc2a-7bbb-403b-bab6-898c4a2ba064]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-13ab8f98-992b-48fb-9337-22be228707d5 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" acquired by "attach_volume" :: waited 0.074s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-13ab8f98-992b-48fb-9337-22be228707d5 tempest-VolumesActionsTest-1367464851 None] Attaching volume 741a7e11-98cb-4c6a-a07d-630a8563a600 to instance 1df78494-20c0-4657-957a-cb6fb655e2da at mountpoint /dev/vdb on host None. Jul 09 09:22:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-13ab8f98-992b-48fb-9337-22be228707d5 tempest-VolumesActionsTest-1367464851 None] Attach volume completed successfully. Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-13ab8f98-992b-48fb-9337-22be228707d5 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" released by "attach_volume" :: held 0.200s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:21 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD Jul 09 09:22:21 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-68a267bc-8898-4e84-8e8a-98b0364e2fe6 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" by "detach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-68a267bc-8898-4e84-8e8a-98b0364e2fe6 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68a267bc-8898-4e84-8e8a-98b0364e2fe6 tempest-VolumesActionsTest-1367464851 None] Detaching volume 741a7e11-98cb-4c6a-a07d-630a8563a600 from instance 1df78494-20c0-4657-957a-cb6fb655e2da. Jul 09 09:22:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68a267bc-8898-4e84-8e8a-98b0364e2fe6 tempest-VolumesActionsTest-1367464851 None] Detach volume completed successfully. Jul 09 09:22:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-68a267bc-8898-4e84-8e8a-98b0364e2fe6 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" released by "detach_volume" :: held 0.251s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:22 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD" returned: 0 in 1.597s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:22 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] 7c391f23-175f-4461-b6ef-8981ab0baaf6 was qcow2, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:22:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:22 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:22 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:25 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 0 in 2.661s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:25 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_l7ad1r52devstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:22:25 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Converted 112.00 MB image at 42.04 MB/s Jul 09 09:22:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:25 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1G Jul 09 09:22:25 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:26 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 1G" returned: 0 in 0.881s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eedee6e-b0ff-4f72-97f7-66bf14a0edec]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:26 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:26 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-959f5854-7ecd-446a-a2a4-bc3f667f2832-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-959f5854-7ecd-446a-a2a4-bc3f667f2832-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-quobyte-959f5854-7ecd-446a-a2a4-bc3f667f2832" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-959f5854-7ecd-446a-a2a4-bc3f667f2832" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3dad1a-6517-49e5-95a6-5f5b4e2f6786]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:27 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 Jul 09 09:22:27 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:27 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 0 in 1.446s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:27 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:27 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:28 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832" returned: 0 in 1.105s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:28 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832 Jul 09 09:22:28 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:28 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 1 in 0.890s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Downloaded image 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0 successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 for user 2274e6538e74487c99d4fc4e31424261 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Marking volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0 as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Copying metadata from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 to 59d209f7-e797-4a29-a23c-ed03ba4f0db0. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Creating volume glance metadata for volume 59d209f7-e797-4a29-a23c-ed03ba4f0db0 backed by image 7c391f23-175f-4461-b6ef-8981ab0baaf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f8f4d2-e7be-4249-a262-348306e3f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bf20bf-1c03-423a-ba5e-b01902b2d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Volume volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 (59d209f7-e797-4a29-a23c-ed03ba4f0db0): created successfully Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bf20bf-1c03-423a-ba5e-b01902b2d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (5382e3c4-6654-44ab-86db-77f129df08f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-682fa6c5-9dcb-4e70-8288-c02845f325ef tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:22:28 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-959f5854-7ecd-446a-a2a4-bc3f667f2832" returned: 0 in 0.735s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-959f5854-7ecd-446a-a2a4-bc3f667f2832" released by "delete_volume" :: held 1.931s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Created reservations ['898e58f7-f5c7-47b7-998d-4d5cbad32783', '413ae3bb-260d-4d61-b445-001a87e7734f', 'a9be953c-0519-4450-8348-616a44daa774', '6833d27a-b491-4b16-a149-092d11449b2e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:29 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:29 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-93d08f08-b0b6-41cf-8b5f-7ee76e89e023-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-93d08f08-b0b6-41cf-8b5f-7ee76e89e023-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-quobyte-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[920a3b37-575c-449d-8a64-3e707e253534]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:29 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 Jul 09 09:22:29 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:29 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.907s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Deleted volume successfully. Jul 09 09:22:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b6490282-c95e-47ec-8e7f-b83af2804487 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-959f5854-7ecd-446a-a2a4-bc3f667f2832-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:30 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" returned: 0 in 1.518s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:30 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023 Jul 09 09:22:30 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (48cc8b01-8ef6-4f2f-afae-81e1375fba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94506324-fd74-4296-9326-ad72d43e16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94506324-fd74-4296-9326-ad72d43e16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-597382885',display_name='tempest-VolumesGetTest-Volume-1329832674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82215cd4-0d0c-40c1-9247-6f8ac93ddc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:31Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d0e339-fe95-4360-8ac8-71c6a10df338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d0e339-fe95-4360-8ac8-71c6a10df338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1452ec3a-dc6f-45d2-8261-d0d2ea9137b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1452ec3a-dc6f-45d2-8261-d0d2ea9137b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82215cd4-0d0c-40c1-9247-6f8ac93ddc82', 'volume_name': 'volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a45e26-895a-41bc-a297-6bd76755e2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a45e26-895a-41bc-a297-6bd76755e2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217db933-8112-4f99-9cbc-36160f0da091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:31 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Volume 82215cd4-0d0c-40c1-9247-6f8ac93ddc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82', 'volume_size': 1} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-597382885',display_name='tempest-VolumesGetTest-Volume-1329832674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82215cd4-0d0c-40c1-9247-6f8ac93ddc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4972ff75046398022b20add637ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:31Z,use_quota=True,user_id='2274e6538e74487c99d4fc4e31424261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Creating volume 82215cd4-0d0c-40c1-9247-6f8ac93ddc82 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:31 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:31 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 1073741824 Jul 09 09:22:31 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:32 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" returned: 0 in 1.242s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-93d08f08-b0b6-41cf-8b5f-7ee76e89e023" released by "delete_volume" :: held 2.815s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Created reservations ['f485870f-9e38-4ccd-9acd-7ceea39ae1dd', '604190a2-3365-4820-ba38-5f631fc46a29', 'e053e6c0-48cf-425b-a3b5-bb0737069262', '023d49bb-0dc8-4a55-9599-7a0f66e3481b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:32 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:32 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:32 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 1073741824" returned: 0 in 1.369s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:32 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 Jul 09 09:22:32 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-3c69ada3-a267-4ea8-bf2b-a27c6abf4737-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-3c69ada3-a267-4ea8-bf2b-a27c6abf4737-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "cinder-quobyte-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e394acf-5f48-4f93-b4a6-f210f58727d0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:33 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 Jul 09 09:22:33 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:33 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.175s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Deleted volume successfully. Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bfc4e784-020d-4b65-b591-a119ee174457 tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-93d08f08-b0b6-41cf-8b5f-7ee76e89e023-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:33 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" returned: 0 in 1.104s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.535s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217db933-8112-4f99-9cbc-36160f0da091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e9ddcd-06e7-46fd-af77-4e82c4f910ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Volume volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 (82215cd4-0d0c-40c1-9247-6f8ac93ddc82): created successfully Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e9ddcd-06e7-46fd-af77-4e82c4f910ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Flow 'volume_create_manager' (48cc8b01-8ef6-4f2f-afae-81e1375fba77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-eb7a7559-5b8c-48a7-ba69-8a34a37ce8ca tempest-VolumesGetTest-440885248 None] Created volume successfully. Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-82215cd4-0d0c-40c1-9247-6f8ac93ddc82-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "cinder-82215cd4-0d0c-40c1-9247-6f8ac93ddc82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:34 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" returned: 0 in 1.270s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:34 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737 Jul 09 09:22:34 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164b2c5-be90-4130-9697-9ad27611cdab]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:34 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 Jul 09 09:22:34 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:35 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-quobyte-3c69ada3-a267-4ea8-bf2b-a27c6abf4737" released by "delete_volume" :: held 2.169s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Created reservations ['07e5f5da-7362-4627-b28e-2057002962ec', '09e69088-4a61-42bf-baf2-ce53504d5a53', '06ede39f-4eb3-4994-8d3e-462217ab0fca', '2891779a-894d-4047-8725-9c9391c0f463'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:35 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:35 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:35 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" returned: 0 in 1.065s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:35 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82 Jul 09 09:22:35 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:36 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.893s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Deleted volume successfully. Jul 09 09:22:36 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" returned: 0 in 0.814s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10e8f168-b119-4a61-a190-75fb0c65e01e tempest-AttachVolumeTestJSON-1898156594 None] Lock "cinder-3c69ada3-a267-4ea8-bf2b-a27c6abf4737-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-82215cd4-0d0c-40c1-9247-6f8ac93ddc82" released by "delete_volume" :: held 1.939s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Created reservations ['951e068f-c729-464e-a1ad-e71a0eaba6f9', '68192d6d-9ebd-4136-93a4-00ae8b2b1763', '1b69e435-d665-443d-890c-1bba24a56065', 'd0c03eef-bccb-4ac9-a1ea-ea68f06fb6ce'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:36 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:36 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-59d209f7-e797-4a29-a23c-ed03ba4f0db0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "cinder-59d209f7-e797-4a29-a23c-ed03ba4f0db0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Acquiring lock "cinder-quobyte-59d209f7-e797-4a29-a23c-ed03ba4f0db0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-59d209f7-e797-4a29-a23c-ed03ba4f0db0" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3fcb3f-964a-4dfc-800a-d2c304cd5da1]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:37 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:37 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:38 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:38 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:22:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-69f7352b-5921-4c5d-9131-365a83c6cc9c tempest-VolumesGetTest-440885248 None] Lock "cinder-82215cd4-0d0c-40c1-9247-6f8ac93ddc82-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:39 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 0 in 1.927s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:39 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:39 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:40 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 1 in 1.014s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:40 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0 Jul 09 09:22:40 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:40 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-59d209f7-e797-4a29-a23c-ed03ba4f0db0" returned: 0 in 0.769s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "cinder-quobyte-59d209f7-e797-4a29-a23c-ed03ba4f0db0" released by "delete_volume" :: held 3.844s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Created reservations ['5184cb3b-b755-49c6-af11-43969f20ed52', '664b5f09-d077-4e12-8ed5-7f2bcf4c285e', 'ec9ac608-20a9-4294-9298-bed710eb1e5a', '8d85a62c-c017-44bf-9310-f468fd5acaab'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:41 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:41 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:42 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.128s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Deleted volume successfully. Jul 09 09:22:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-528800f3-4d06-48ee-a6ea-ca1385dfee9b tempest-VolumesGetTest-440885248 None] Lock "cinder-59d209f7-e797-4a29-a23c-ed03ba4f0db0-delete_volume" released by "delete_volume" :: held 5.272s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (f3aae1f8-2049-41f0-9f10-898ad700e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc13b09f-e166-4642-a980-e85ca33eb327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc13b09f-e166-4642-a980-e85ca33eb327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-768197090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e824a733-1282-4684-a072-cd800743f82f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:46Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e82276-4ea7-4f51-ace6-f9b0fd4f906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e82276-4ea7-4f51-ace6-f9b0fd4f906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a39543-9afa-494d-b3aa-24ce48b4932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a39543-9afa-494d-b3aa-24ce48b4932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e824a733-1282-4684-a072-cd800743f82f', 'volume_name': 'volume-e824a733-1282-4684-a072-cd800743f82f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429d6e97-bccd-4406-a1c2-ac5099145321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429d6e97-bccd-4406-a1c2-ac5099145321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b643f7-13d9-4cb1-928f-1cf52717a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Volume e824a733-1282-4684-a072-cd800743f82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e824a733-1282-4684-a072-cd800743f82f', 'volume_size': 1} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-768197090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e824a733-1282-4684-a072-cd800743f82f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:46Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Creating volume e824a733-1282-4684-a072-cd800743f82f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:46 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:46 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f 1073741824 Jul 09 09:22:46 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Flow 'volume_create_manager' (e51f07f1-7cc1-450e-926e-e70f2c8119d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067364e-01b2-4ae4-ae14-c83200d6bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e067364e-01b2-4ae4-ae14-c83200d6bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-929350735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae1c552-8bc7-42fc-8122-962c8abc93bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c076d3563d4408b97bded907b51bd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:47Z,use_quota=True,user_id='ff6ef1145c5e42bca90629a523d68fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa7fcfb-0d51-40f4-8e65-cf61373a7698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa7fcfb-0d51-40f4-8e65-cf61373a7698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca2f808-bdc3-481c-bd4d-8dbd8650f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca2f808-bdc3-481c-bd4d-8dbd8650f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae1c552-8bc7-42fc-8122-962c8abc93bd', 'volume_name': 'volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6703ac-98e8-4823-a46f-b9f97ce35b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6703ac-98e8-4823-a46f-b9f97ce35b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08979077-3692-4a10-b6cb-335aacbfdfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Volume 0ae1c552-8bc7-42fc-8122-962c8abc93bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd', 'volume_size': 1} Jul 09 09:22:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:47 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f 1073741824" returned: 0 in 1.080s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-23850689-5a0e-4fdb-91bd-dd0f2d23eeb6 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" by "attach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-23850689-5a0e-4fdb-91bd-dd0f2d23eeb6 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" acquired by "attach_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:47 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f Jul 09 09:22:47 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23850689-5a0e-4fdb-91bd-dd0f2d23eeb6 tempest-VolumesActionsTest-1367464851 None] Attaching volume 741a7e11-98cb-4c6a-a07d-630a8563a600 to instance 131a5001-e4e2-4411-82c8-5b78ce47e312 at mountpoint /dev/vdb on host None. Jul 09 09:22:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23850689-5a0e-4fdb-91bd-dd0f2d23eeb6 tempest-VolumesActionsTest-1367464851 None] Attach volume completed successfully. Jul 09 09:22:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-23850689-5a0e-4fdb-91bd-dd0f2d23eeb6 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600" released by "attach_volume" :: held 0.122s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-aedc76ab-1667-4143-bee2-a645c6dca60d tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" by "detach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-aedc76ab-1667-4143-bee2-a645c6dca60d tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aedc76ab-1667-4143-bee2-a645c6dca60d tempest-VolumesActionsTest-1367464851 None] Detaching volume 741a7e11-98cb-4c6a-a07d-630a8563a600 from instance 131a5001-e4e2-4411-82c8-5b78ce47e312. Jul 09 09:22:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aedc76ab-1667-4143-bee2-a645c6dca60d tempest-VolumesActionsTest-1367464851 None] Detach volume completed successfully. Jul 09 09:22:48 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-929350735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae1c552-8bc7-42fc-8122-962c8abc93bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c076d3563d4408b97bded907b51bd9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:47Z,use_quota=True,user_id='ff6ef1145c5e42bca90629a523d68fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Creating volume 0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-aedc76ab-1667-4143-bee2-a645c6dca60d tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:22:48 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd 1073741824 Jul 09 09:22:48 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b643f7-13d9-4cb1-928f-1cf52717a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e824a733-1282-4684-a072-cd800743f82f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0faaeef-e19d-4b46-a06c-4a6462ae33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Volume volume-e824a733-1282-4684-a072-cd800743f82f (e824a733-1282-4684-a072-cd800743f82f): created successfully Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0faaeef-e19d-4b46-a06c-4a6462ae33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (f3aae1f8-2049-41f0-9f10-898ad700e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-13d83724-abd3-4be4-bd09-824fe9bda70d tempest-VolumesListTestJSON-1018926208 None] Created volume successfully. Jul 09 09:22:49 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd 1073741824" returned: 0 in 1.048s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:49 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd Jul 09 09:22:49 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:49 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (f0e30819-4486-4a50-99ce-614cdac7ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56a49f3-9e9f-44d6-ad45-2af87c8c0dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56a49f3-9e9f-44d6-ad45-2af87c8c0dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1854296077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d141ba46-0862-4d8e-a621-fcec142602be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:50Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a030958-ca93-4fc6-941d-1f36856ca23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a030958-ca93-4fc6-941d-1f36856ca23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a2412e-4455-4c47-86c1-456e5db65db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a2412e-4455-4c47-86c1-456e5db65db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd141ba46-0862-4d8e-a621-fcec142602be', 'volume_name': 'volume-d141ba46-0862-4d8e-a621-fcec142602be', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802cd0e2-14cf-4941-926e-4ef726061da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802cd0e2-14cf-4941-926e-4ef726061da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8333a4-d1e7-4ab2-a236-c3e2b3bbf86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Volume d141ba46-0862-4d8e-a621-fcec142602be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d141ba46-0862-4d8e-a621-fcec142602be', 'volume_size': 1} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd" returned: 0 in 0.842s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1854296077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d141ba46-0862-4d8e-a621-fcec142602be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:50Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Creating volume d141ba46-0862-4d8e-a621-fcec142602be {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:50 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08979077-3692-4a10-b6cb-335aacbfdfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bf5f76-257a-4186-81fa-ffa0d518ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:50 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be 1073741824 Jul 09 09:22:50 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Volume volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd (0ae1c552-8bc7-42fc-8122-962c8abc93bd): created successfully Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bf5f76-257a-4186-81fa-ffa0d518ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Flow 'volume_create_manager' (e51f07f1-7cc1-450e-926e-e70f2c8119d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-f8185334-f28d-4baa-9693-7b8809cdc6b9 req-efff235e-d854-49bd-a54f-dd1e4d6c64e7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Created volume successfully. Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:50 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:22:50 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:51 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be 1073741824" returned: 0 in 1.382s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:51 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.085s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:22:51 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be Jul 09 09:22:51 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:52 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be" returned: 0 in 0.922s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.555s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Creating offline snapshot 5ad745d3-e257-4390-b35d-bf2aacf770b1 of volume 0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8333a4-d1e7-4ab2-a236-c3e2b3bbf86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d141ba46-0862-4d8e-a621-fcec142602be', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f5ceea-f785-4546-a18e-a482cf5fac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c6617-db5e-4c57-b93e-2c58fa2016e1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Volume volume-d141ba46-0862-4d8e-a621-fcec142602be (d141ba46-0862-4d8e-a621-fcec142602be): created successfully Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f5ceea-f785-4546-a18e-a482cf5fac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (f0e30819-4486-4a50-99ce-614cdac7ce05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-20b138dc-5bca-4139-b3e6-5ee64e352055 tempest-VolumesListTestJSON-1018926208 None] Created volume successfully. Jul 09 09:22:52 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd Jul 09 09:22:52 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:53 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd" returned: 0 in 0.797s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:53 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 1G Jul 09 09:22:53 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (7fbb6500-d516-4761-a2ff-3ebb2312cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69e32cc-5029-49a5-bea7-173e30aad82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69e32cc-5029-49a5-bea7-173e30aad82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1718013910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19f9c22-a1b5-4944-b44c-c0affbad810c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:54Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0949a41-f018-4b91-ae4a-b953dd3a2a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0949a41-f018-4b91-ae4a-b953dd3a2a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ddd8fc-fb00-4fc3-a7ae-da009154067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ddd8fc-fb00-4fc3-a7ae-da009154067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19f9c22-a1b5-4944-b44c-c0affbad810c', 'volume_name': 'volume-b19f9c22-a1b5-4944-b44c-c0affbad810c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ee803b-7026-4fde-add5-eaa18e3e9931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ee803b-7026-4fde-add5-eaa18e3e9931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edfe097-3879-4de8-84dc-880384023396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:53 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Volume b19f9c22-a1b5-4944-b44c-c0affbad810c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19f9c22-a1b5-4944-b44c-c0affbad810c', 'volume_size': 1} Jul 09 09:22:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:54 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 1G" returned: 0 in 0.898s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:54 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 Jul 09 09:22:54 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (33eb60d0-09ac-401d-b8d2-e425810949cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab629688-2551-43ea-bba9-3d21d9b96e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab629688-2551-43ea-bba9-3d21d9b96e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1444503785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65010c3c-4153-4c6f-8cc7-b70ea7dfecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:54Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf5086-0aa0-4c9d-8a02-96637382c1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf5086-0aa0-4c9d-8a02-96637382c1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773f6f7c-1445-4c57-9833-f2b75c0e36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773f6f7c-1445-4c57-9833-f2b75c0e36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65010c3c-4153-4c6f-8cc7-b70ea7dfecb2', 'volume_name': 'volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a720553-010a-4b31-be4d-e579ce9250a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a720553-010a-4b31-be4d-e579ce9250a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483fd358-9611-4859-ae24-abc43e9135fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Volume 65010c3c-4153-4c6f-8cc7-b70ea7dfecb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2', 'volume_size': 1} Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:54 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1" returned: 0 in 0.745s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:54 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 is being set with open permissions: ugo+rw Jul 09 09:22:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:54 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 Jul 09 09:22:54 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:55 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1" returned: 0 in 0.686s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:55 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info Jul 09 09:22:55 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:56 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info" returned: 0 in 0.651s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:56 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info is being set with open permissions: ugo+rw Jul 09 09:22:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:56 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info Jul 09 09:22:56 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:57 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.info" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.277s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1718013910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19f9c22-a1b5-4944-b44c-c0affbad810c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='811d2e3517e641b2a683d0c9facec1db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:54Z,use_quota=True,user_id='566dead17834464eaf570499fbe78e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Creating volume b19f9c22-a1b5-4944-b44c-c0affbad810c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:57 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:57 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c 1073741824 Jul 09 09:22:57 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-6701a56e-c75b-4339-9906-9290cdd7447f req-2ac55bcb-5939-492e-a0dc-f3b61b473735 tempest-VolumesSnapshotsTestJSON-1245629846 None] Create snapshot completed successfully Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "cinder-5ad745d3-e257-4390-b35d-bf2aacf770b1-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-5ad745d3-e257-4390-b35d-bf2aacf770b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "cinder-quobyte-5ad745d3-e257-4390-b35d-bf2aacf770b1" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-5ad745d3-e257-4390-b35d-bf2aacf770b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Deleting offline snapshot 5ad745d3-e257-4390-b35d-bf2aacf770b1 of volume 0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] snapshot_file for this snap is: volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa35033-5a43-4efc-9354-4252febe59a7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:57 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 Jul 09 09:22:57 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:58 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c 1073741824" returned: 0 in 0.949s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:58 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c Jul 09 09:22:58 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:58 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1" returned: 0 in 0.794s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a895b96-092c-4e68-b74b-485275362acb]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:58 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd Jul 09 09:22:58 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:58 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c" returned: 0 in 0.683s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1444503785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65010c3c-4153-4c6f-8cc7-b70ea7dfecb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:54Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Creating volume 65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:22:58 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:58 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 1073741824 Jul 09 09:22:58 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edfe097-3879-4de8-84dc-880384023396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19f9c22-a1b5-4944-b44c-c0affbad810c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de6ef00-e71e-4d72-a448-532fac77f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:22:58 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Volume volume-b19f9c22-a1b5-4944-b44c-c0affbad810c (b19f9c22-a1b5-4944-b44c-c0affbad810c): created successfully Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de6ef00-e71e-4d72-a448-532fac77f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:22:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Flow 'volume_create_manager' (7fbb6500-d516-4761-a2ff-3ebb2312cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:22:58 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-898ef9e6-5fc0-4cce-93f9-82cf78654435 tempest-VolumesListTestJSON-1018926208 None] Created volume successfully. Jul 09 09:22:59 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:59 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 Jul 09 09:22:59 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:22:59 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 09 09:22:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 1073741824" returned: 0 in 0.883s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:22:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:22:59 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 Jul 09 09:22:59 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:00 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1" returned: 0 in 0.807s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:00 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1 Jul 09 09:23:00 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:00 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" returned: 0 in 0.696s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.440s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483fd358-9611-4859-ae24-abc43e9135fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2244152-9db6-4c10-ba1e-53f64eb42b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8ac58-67f2-4e75-a191-52a2b8221a53]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Volume volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 (65010c3c-4153-4c6f-8cc7-b70ea7dfecb2): created successfully Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2244152-9db6-4c10-ba1e-53f64eb42b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (33eb60d0-09ac-401d-b8d2-e425810949cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-446bb4dd-a041-4803-b1ba-4e3902b3888a tempest-AttachVolumeNegativeTest-689033810 None] Created volume successfully. Jul 09 09:23:00 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:00 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:00 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd.5ad745d3-e257-4390-b35d-bf2aacf770b1" returned: 0 in 0.685s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-5ad745d3-e257-4390-b35d-bf2aacf770b1" released by "_delete_snapshot" :: held 3.255s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" released by "delete_snapshot" :: held 3.282s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:00 devstack cinder-volume[87265]: DEBUG cinder.quota [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Created reservations ['eb051095-1e03-432d-8581-2d0158ee7adb', '818c44ba-f40c-4095-9156-0bf64545854f', 'ea753dd0-605d-435c-b4e1-e74774e7768e', '46c5244c-5aa5-4b3e-b0b5-5c9c7bc96bdd'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Delete snapshot completed successfully. Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-4733ab45-44ba-49dc-8cb5-b2c3480454b0 req-2c3c66ef-d23e-4444-bc53-2a22cc1ab232 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-5ad745d3-e257-4390-b35d-bf2aacf770b1-delete_snapshot" released by "delete_snapshot" :: held 3.474s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-b19f9c22-a1b5-4944-b44c-c0affbad810c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-b19f9c22-a1b5-4944-b44c-c0affbad810c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-quobyte-b19f9c22-a1b5-4944-b44c-c0affbad810c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:01 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-b19f9c22-a1b5-4944-b44c-c0affbad810c" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.889s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a93448-b0b5-4638-840b-2735d6a25ebe]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852540d-bb20-4c45-bf2c-79252269142d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:01 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c Jul 09 09:23:01 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:01 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:01 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "cinder-0ae1c552-8bc7-42fc-8122-962c8abc93bd-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-0ae1c552-8bc7-42fc-8122-962c8abc93bd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:02 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c" returned: 0 in 0.848s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8137b37-6e23-4a4a-8030-bc74e8f1edf0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:02 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:02 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c Jul 09 09:23:02 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.871s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.f761fb5f-54e3-4be8-a040-fef5068d117a0585jy4p.img {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:02 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.f761fb5f-54e3-4be8-a040-fef5068d117a0585jy4p.img Jul 09 09:23:02 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:02 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd Jul 09 09:23:02 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:02 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b19f9c22-a1b5-4944-b44c-c0affbad810c" returned: 0 in 0.732s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-b19f9c22-a1b5-4944-b44c-c0affbad810c" released by "delete_volume" :: held 1.634s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Created reservations ['d645ac78-949e-422c-add7-4c5db60be325', '7bb62fb5-d821-4528-a9dd-958595fc8e02', 'bac9a066-e12a-4d50-9115-495df6c3fef5', '67cb0eee-ae7e-4b2b-a968-02139dd8db57'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:03 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd" returned: 0 in 0.967s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:03 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd Jul 09 09:23:03 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:03 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:03 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-d141ba46-0862-4d8e-a621-fcec142602be-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-d141ba46-0862-4d8e-a621-fcec142602be-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-quobyte-d141ba46-0862-4d8e-a621-fcec142602be" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-d141ba46-0862-4d8e-a621-fcec142602be" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c7a75-adf2-4075-bf84-cc8e1bba2c11]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:04 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be Jul 09 09:23:04 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:04 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ae1c552-8bc7-42fc-8122-962c8abc93bd" returned: 0 in 1.581s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-quobyte-0ae1c552-8bc7-42fc-8122-962c8abc93bd" released by "delete_volume" :: held 2.673s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:04 devstack cinder-volume[87265]: DEBUG cinder.quota [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Created reservations ['21962260-5356-463d-bf8d-66b2cabdce19', '7c76d755-7137-4d1b-9032-caf0afb969bf', '3f7fa7f3-f125-4571-8e9c-54d406a99354', 'bc3b2070-37a8-4f66-8d35-b6e5a746a81c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:05 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:05 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:05 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 2.352s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Deleted volume successfully. Jul 09 09:23:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca91eeb4-1556-47c9-bcce-3e1f46da2432 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-b19f9c22-a1b5-4944-b44c-c0affbad810c-delete_volume" released by "delete_volume" :: held 4.587s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:06 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be" returned: 0 in 2.344s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:06 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be Jul 09 09:23:06 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:07 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 2.304s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:07 devstack cinder-volume[87265]: DEBUG cinder.manager [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Deleted volume successfully. Jul 09 09:23:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-0fc59f20-ceae-466c-8816-0e1b8b5e9a8a req-11b2f7fd-0955-466e-b5ce-986fa25ccea7 tempest-VolumesSnapshotsTestJSON-1245629846 None] Lock "cinder-0ae1c552-8bc7-42fc-8122-962c8abc93bd-delete_volume" released by "delete_volume" :: held 5.699s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:08 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d141ba46-0862-4d8e-a621-fcec142602be" returned: 0 in 1.706s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:08 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.f761fb5f-54e3-4be8-a040-fef5068d117a0585jy4p.img" returned: 0 in 6.135s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-d141ba46-0862-4d8e-a621-fcec142602be" released by "delete_volume" :: held 4.158s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c48c26-3646-459d-a1e1-a5bfada61e46]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Created reservations ['df8febe7-4bae-4dc4-88d6-86ea45ccd2d9', 'eb8ca661-9202-4ee4-aa39-05991bda0bde', 'babdcee7-0b76-4bce-a35e-fce396333c28', '1b9afb24-1695-405c-b9f4-18ae96e81ce8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:08 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:08 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:08 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:08 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-e824a733-1282-4684-a072-cd800743f82f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-e824a733-1282-4684-a072-cd800743f82f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=95,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "cinder-quobyte-e824a733-1282-4684-a072-cd800743f82f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-e824a733-1282-4684-a072-cd800743f82f" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3470d53-94ae-4b22-adc4-01a745b87fc0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:09 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.787s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Deleted volume successfully. Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-86cd611f-9e97-4adc-88dc-e316abbff398 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-d141ba46-0862-4d8e-a621-fcec142602be-delete_volume" released by "delete_volume" :: held 5.300s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:09 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f Jul 09 09:23:09 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:09 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 1.211s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.f761fb5f-54e3-4be8-a040-fef5068d117a0585jy4p.img {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:23:09 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Converted 1024.00 MB image at 166.87 MB/s Jul 09 09:23:09 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] f761fb5f-54e3-4be8-a040-fef5068d117a was raw, no need to convert to raw {{(pid=87265) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 09:23:10 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f" returned: 0 in 0.900s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:10 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f Jul 09 09:23:10 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:10 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e824a733-1282-4684-a072-cd800743f82f" returned: 0 in 0.786s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-quobyte-e824a733-1282-4684-a072-cd800743f82f" released by "delete_volume" :: held 1.789s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Created reservations ['8b8f2d5a-5ff7-4236-8a6e-0ed85b064286', '0a73cd68-6f05-4a79-be89-a4ad43f660d2', '4d73941b-03b0-4df3-97b2-501613aada4f', '77d0002b-7449-485f-8724-efb63f43663c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:11 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:11 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:11 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.748s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Deleted volume successfully. Jul 09 09:23:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-113ffd46-d3c8-44dd-88b0-dcab2d53d6b1 tempest-VolumesListTestJSON-1018926208 None] Lock "cinder-e824a733-1282-4684-a072-cd800743f82f-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=94,cinder:INSERT=41,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (ec5cb45a-c180-4fa7-8863-baba8b26bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b38ff3-ca96-4c16-a494-d6ad2654e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b38ff3-ca96-4c16-a494-d6ad2654e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697419374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335e2dcf-2b14-4f97-baaa-3423b7dbdb14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:12Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ac833e-217c-40ae-81d7-0d1283b449f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ac833e-217c-40ae-81d7-0d1283b449f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b4e9e2-7c8f-40b4-afda-0e0234a97291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b4e9e2-7c8f-40b4-afda-0e0234a97291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335e2dcf-2b14-4f97-baaa-3423b7dbdb14', 'volume_name': 'volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495520c1-4b78-4815-a447-14c93a689441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495520c1-4b78-4815-a447-14c93a689441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ae138f-33bb-430d-867b-e8c149db2521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Volume 335e2dcf-2b14-4f97-baaa-3423b7dbdb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14', 'volume_size': 1} Jul 09 09:23:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Flow 'volume_create_manager' (bd694d85-f5df-494b-9f6e-0e9725113a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f610da-013c-4ded-b13e-a10f9c3e1677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f610da-013c-4ded-b13e-a10f9c3e1677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1332296062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a531623f-1af6-4d8b-8542-aa7c7c5f2556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9b177b5210468682d80d894a64d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:15Z,use_quota=True,user_id='cb9bbadc3a314f389e9442fb4c338063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0780a47-dd0e-46cc-b305-9b38d48af91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0780a47-dd0e-46cc-b305-9b38d48af91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2747618-1347-4290-894d-67a0c0c344f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2747618-1347-4290-894d-67a0c0c344f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a531623f-1af6-4d8b-8542-aa7c7c5f2556', 'volume_name': 'volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0175dd-3025-437c-bc82-113cfb5ad2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0175dd-3025-437c-bc82-113cfb5ad2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dda1fd-d591-4950-a38a-191b1fbb5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:15 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Volume a531623f-1af6-4d8b-8542-aa7c7c5f2556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556', 'volume_size': 1} Jul 09 09:23:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:25 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:23:25 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.734s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Uploaded volume to glance image-id: f761fb5f-54e3-4be8-a040-fef5068d117a. {{(pid=87265) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.847s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe2aa4-739d-4b97-83ae-b8d0ab78f0df]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fb624d6a-2f2c-4287-be6d-953917b9fc12 tempest-VolumesActionsTest-1367464851 None] Copy volume to image completed successfully. Jul 09 09:23:29 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 Jul 09 09:23:29 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:29 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" returned: 0 in 0.800s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.792s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697419374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335e2dcf-2b14-4f97-baaa-3423b7dbdb14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:12Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Creating volume 335e2dcf-2b14-4f97-baaa-3423b7dbdb14 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:23:29 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:23:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:29 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 1073741824 Jul 09 09:23:29 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1d0c771-c750-4733-bad2-1d859c6c0538', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:23:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-04dd43ff-1ff5-4f64-9066-82fa5fdcc90d req-346995b6-6b23-4f4f-baa8-a3012afda2e6 tempest-AttachVolumeNegativeTest-689033810 None] attachment_update completed successfully. Jul 09 09:23:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:30 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 1073741824" returned: 0 in 0.948s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:30 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 Jul 09 09:23:30 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:31 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" returned: 0 in 0.674s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.347s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1332296062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a531623f-1af6-4d8b-8542-aa7c7c5f2556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9b177b5210468682d80d894a64d3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:15Z,use_quota=True,user_id='cb9bbadc3a314f389e9442fb4c338063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Creating volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:23:31 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:31 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 1073741824 Jul 09 09:23:31 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ae138f-33bb-430d-867b-e8c149db2521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143257c1-8284-487c-ab57-19d91cb2cea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:31 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Volume volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 (335e2dcf-2b14-4f97-baaa-3423b7dbdb14): created successfully Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143257c1-8284-487c-ab57-19d91cb2cea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (ec5cb45a-c180-4fa7-8863-baba8b26bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f7e25573-3d56-4db9-952e-98febc5867bc tempest-VolumesTestJSON-947768569 None] Created volume successfully. Jul 09 09:23:32 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 1073741824" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:32 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 Jul 09 09:23:32 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (c10fa2d9-9166-4d7d-9e72-c1ad4aa453f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6c6f0-8c19-4a2c-9854-b91600769680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6c6f0-8c19-4a2c-9854-b91600769680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-869746450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57242553-b4a4-4598-823b-88896fcd86a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:33Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d01415-dcc3-4586-aa8e-61a01f3e4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d01415-dcc3-4586-aa8e-61a01f3e4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ed3a43-9960-49eb-8992-b66ad6e54ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ed3a43-9960-49eb-8992-b66ad6e54ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57242553-b4a4-4598-823b-88896fcd86a0', 'volume_name': 'volume-57242553-b4a4-4598-823b-88896fcd86a0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5bbf08-b43a-449a-b7b1-7e0661460317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5bbf08-b43a-449a-b7b1-7e0661460317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c8b53d-6af8-439f-b69f-37c919668a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Volume 57242553-b4a4-4598-823b-88896fcd86a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57242553-b4a4-4598-823b-88896fcd86a0', 'volume_size': 1} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556" returned: 0 in 0.717s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.544s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dda1fd-d591-4950-a38a-191b1fbb5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a709217-8536-4a47-83dd-02721ae25a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eef501-b646-4142-91d6-72964b4c1c06]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Volume volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 (a531623f-1af6-4d8b-8542-aa7c7c5f2556): created successfully Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a709217-8536-4a47-83dd-02721ae25a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Flow 'volume_create_manager' (bd694d85-f5df-494b-9f6e-0e9725113a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f64c2052-0cf9-4c3f-8c46-59f7e178aaae tempest-VolumesSnapshotListTestJSON-1745794145 None] Created volume successfully. Jul 09 09:23:33 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:33 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:34 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e61ea6b-1f06-43c6-af48-9f3ff49caecc]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:34 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:34 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:34 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:34 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img Jul 09 09:23:34 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:40 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img" returned: 0 in 5.151s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af2847-dc1f-4058-8553-d4ffe8943ebd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:40 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:40 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:41 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.965s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:23:41 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Converted 1024.00 MB image at 198.76 MB/s Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] b1e5ca39-67de-4d2b-b817-94577a54a754 was raw, converting to qcow2 {{(pid=87265) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a7a3ab-f610-4133-9d4c-580d3b538db0]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:41 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img Jul 09 09:23:41 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:41 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img" returned: 0 in 0.736s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:41 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img Jul 09 09:23:41 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:42 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img" returned: 1 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:23:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img /opt/stack/data/cinder/conversion/vol_upload_f0857fpn {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:42 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img /opt/stack/data/cinder/conversion/vol_upload_f0857fpn Jul 09 09:23:42 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:43 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img /opt/stack/data/cinder/conversion/vol_upload_f0857fpn" returned: 0 in 1.127s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:43 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Image conversion details: src /opt/stack/data/cinder/conversion/741a7e11-98cb-4c6a-a07d-630a8563a600.temp_image.b1e5ca39-67de-4d2b-b817-94577a54a754e3ss97sa.img, size 1024.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f0857fpn {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:23:43 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Converted 1024.00 MB image at 907.88 MB/s Jul 09 09:23:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[281cbb33-0525-4244-8c2d-3763d640431f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f0857fpn {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:43 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f0857fpn Jul 09 09:23:43 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:44 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f0857fpn" returned: 0 in 0.716s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.710s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Uploaded volume to glance image-id: b1e5ca39-67de-4d2b-b817-94577a54a754. {{(pid=87265) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.721s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-869746450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57242553-b4a4-4598-823b-88896fcd86a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:33Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Creating volume 57242553-b4a4-4598-823b-88896fcd86a0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:23:45 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:23:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:45 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 1073741824 Jul 09 09:23:45 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9e3cfa30-91b0-4ca1-acba-88ea0b2a5f66 tempest-VolumesActionsTest-1367464851 None] Copy volume to image completed successfully. Jul 09 09:23:46 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 1073741824" returned: 0 in 0.934s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:47 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 Jul 09 09:23:47 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "cinder-quobyte-741a7e11-98cb-4c6a-a07d-630a8563a600" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-quobyte-741a7e11-98cb-4c6a-a07d-630a8563a600" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ec11e7-208f-459e-babc-b83afaf3f3ec]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:47 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:47 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:47 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Creating offline snapshot e163b294-0a2c-4c22-a503-eaf8a86aa1d7 of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c8b53d-6af8-439f-b69f-37c919668a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57242553-b4a4-4598-823b-88896fcd86a0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3644018-8a5a-4087-b445-3205d138cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d40e43-453c-4559-a68f-1a3e27d9cb78]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:47 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Volume volume-57242553-b4a4-4598-823b-88896fcd86a0 (57242553-b4a4-4598-823b-88896fcd86a0): created successfully Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3644018-8a5a-4087-b445-3205d138cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (c10fa2d9-9166-4d7d-9e72-c1ad4aa453f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e85e0e16-9644-4946-b50d-e33a8b13002c tempest-VolumesTestJSON-947768569 None] Created volume successfully. Jul 09 09:23:47 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 Jul 09 09:23:47 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:48 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.794s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:48 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600 Jul 09 09:23:48 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:48 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556" returned: 0 in 0.936s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:48 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 1G Jul 09 09:23:48 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:48 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-741a7e11-98cb-4c6a-a07d-630a8563a600" returned: 0 in 0.770s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-quobyte-741a7e11-98cb-4c6a-a07d-630a8563a600" released by "delete_volume" :: held 1.629s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Created reservations ['612eef9e-0583-42e4-9caa-caf5fcb9d7fb', '7084140f-ae2c-452a-82bf-beff6f09adab', '17798cae-d798-4ed2-892a-bad7831c6c64', 'bab46544-3ac9-4e33-b6ee-93d55273e452'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (de59463e-ee9d-4d75-ace9-f9670ba077e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf9de09-1d86-43f4-9613-4846d76d386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf9de09-1d86-43f4-9613-4846d76d386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-152039311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83c6bf0-388c-488b-a59b-64534b92e50d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:49Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9cbbf5-69bf-461d-8859-fb566bb15841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9cbbf5-69bf-461d-8859-fb566bb15841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4db9f2-d7b2-4905-9d6b-2532bc52cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4db9f2-d7b2-4905-9d6b-2532bc52cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83c6bf0-388c-488b-a59b-64534b92e50d', 'volume_name': 'volume-d83c6bf0-388c-488b-a59b-64534b92e50d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa62f580-505f-4b2d-8cd8-f18e4c876476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa62f580-505f-4b2d-8cd8-f18e4c876476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4064628-6acc-40cd-83ca-aadd6a1f5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Volume d83c6bf0-388c-488b-a59b-64534b92e50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83c6bf0-388c-488b-a59b-64534b92e50d', 'volume_size': 1} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:49 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:49 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:49 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 1G" returned: 0 in 0.857s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:49 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:23:49 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:49 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.687s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Deleted volume successfully. Jul 09 09:23:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2babe7f6-4ec9-45b0-9270-4cdf050778f9 tempest-VolumesActionsTest-1367464851 None] Lock "cinder-741a7e11-98cb-4c6a-a07d-630a8563a600-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:50 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 0.977s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:50 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 is being set with open permissions: ugo+rw Jul 09 09:23:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:50 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:50 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:50 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:23:50 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:51 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.902s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:23:51 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 0.853s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:51 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info Jul 09 09:23:51 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:52 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info" returned: 0 in 0.715s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:52 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info is being set with open permissions: ugo+rw Jul 09 09:23:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:52 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info Jul 09 09:23:52 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:53 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.info" returned: 0 in 0.959s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.410s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.087s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-152039311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83c6bf0-388c-488b-a59b-64534b92e50d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='062dd6ad57284b6482acb9dbbb3703c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:49Z,use_quota=True,user_id='af4e9ee36bce47ed8a6df8ea06456368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Creating volume d83c6bf0-388c-488b-a59b-64534b92e50d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:23:53 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:23:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:53 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d 1073741824 Jul 09 09:23:53 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2b033659-e85e-4fdf-ab63-172de1fd6c8c tempest-VolumesSnapshotListTestJSON-1745794145 None] Create snapshot completed successfully Jul 09 09:23:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:54 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d 1073741824" returned: 0 in 1.376s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:54 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d Jul 09 09:23:54 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:55 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d" returned: 0 in 0.833s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.112s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Creating offline snapshot 42150d64-889b-4ad9-8fd0-9ba8c770bf3b of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4064628-6acc-40cd-83ca-aadd6a1f5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83c6bf0-388c-488b-a59b-64534b92e50d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed68b9b-9e9f-4824-8887-2558d57b6d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed87b4a-f0d4-47d5-84f0-b3feda8b24a2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Volume volume-d83c6bf0-388c-488b-a59b-64534b92e50d (d83c6bf0-388c-488b-a59b-64534b92e50d): created successfully Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed68b9b-9e9f-4824-8887-2558d57b6d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Flow 'volume_create_manager' (de59463e-ee9d-4d75-ace9-f9670ba077e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-35af3e1c-01fa-4d89-9137-72d3ddbf3fb1 tempest-VolumesTestJSON-947768569 None] Created volume successfully. Jul 09 09:23:55 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:23:55 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:56 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 1.250s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:23:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:56 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b 1G Jul 09 09:23:56 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Flow 'volume_create_manager' (dc2c87e0-7cb6-4be0-9193-7767126aeab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dc2c05-aa82-4856-b639-1717beb7d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dc2c05-aa82-4856-b639-1717beb7d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1401334716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720291f-197d-42ed-9ef9-fd8b1dab2b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff3b5735ab24813aa812ab86a1d2b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='a330bcfd23514d1da6acebeece4619d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99988db9-f934-4517-a9dc-9fd1c346b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99988db9-f934-4517-a9dc-9fd1c346b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd406f0-eb1e-4307-8b21-6837a97654ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd406f0-eb1e-4307-8b21-6837a97654ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9720291f-197d-42ed-9ef9-fd8b1dab2b20', 'volume_name': 'volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774cb55a-364d-4b87-a4b3-86da56a2c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774cb55a-364d-4b87-a4b3-86da56a2c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36e69e-4307-4f66-8922-7dc643468133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:23:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Volume 9720291f-197d-42ed-9ef9-fd8b1dab2b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20', 'volume_size': 1} Jul 09 09:23:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-d83c6bf0-388c-488b-a59b-64534b92e50d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "cinder-d83c6bf0-388c-488b-a59b-64534b92e50d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-quobyte-d83c6bf0-388c-488b-a59b-64534b92e50d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-d83c6bf0-388c-488b-a59b-64534b92e50d" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a960d0c-69ca-49d4-bc87-b01fb5acaf06]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:58 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b 1G" returned: 0 in 1.469s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:58 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:23:58 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:58 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d Jul 09 09:23:58 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:59 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d" returned: 0 in 0.834s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:59 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 0.813s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:59 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b is being set with open permissions: ugo+rw Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:59 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d Jul 09 09:23:59 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:59 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:23:59 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:59 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d83c6bf0-388c-488b-a59b-64534b92e50d" returned: 0 in 0.680s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-d83c6bf0-388c-488b-a59b-64534b92e50d" released by "delete_volume" :: held 1.561s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Created reservations ['3abc7924-534a-4fa1-a516-6c9db816a7d9', 'ee299b4e-8cbb-49b8-a993-efeef4d7ff56', 'e05b5869-c447-4c81-9e77-a8b25a603e23', '59c7892f-40f3-4a7b-a186-b7f021a04316'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:23:59 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 0.753s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1401334716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720291f-197d-42ed-9ef9-fd8b1dab2b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff3b5735ab24813aa812ab86a1d2b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='a330bcfd23514d1da6acebeece4619d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Creating volume 9720291f-197d-42ed-9ef9-fd8b1dab2b20 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:23:59 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:59 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 1073741824 Jul 09 09:23:59 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:23:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-254bfb32-fa08-43a1-8755-42a6d8b8c279 tempest-VolumesSnapshotListTestJSON-1745794145 None] Create snapshot completed successfully Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:23:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:23:59 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:23:59 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-57242553-b4a4-4598-823b-88896fcd86a0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "cinder-57242553-b4a4-4598-823b-88896fcd86a0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-quobyte-57242553-b4a4-4598-823b-88896fcd86a0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-57242553-b4a4-4598-823b-88896fcd86a0" acquired by "delete_volume" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f6d1d-5094-4f59-a043-54b0abac1557]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:00 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 Jul 09 09:24:00 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:00 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.840s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Deleted volume successfully. Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d2d287e1-2e81-4e90-a046-9eea602c38cf tempest-VolumesTestJSON-947768569 None] Lock "cinder-d83c6bf0-388c-488b-a59b-64534b92e50d-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:00 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 1073741824" returned: 0 in 1.021s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:01 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 Jul 09 09:24:01 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:01 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0" returned: 0 in 0.979s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:01 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0 Jul 09 09:24:01 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:01 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20" returned: 0 in 0.663s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36e69e-4307-4f66-8922-7dc643468133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637c55d8-13ba-4c0b-adbf-efe239b38592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Creating offline snapshot 7e0873d0-01b5-4e35-9366-e70e9f556f2c of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:24:01 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Volume volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 (9720291f-197d-42ed-9ef9-fd8b1dab2b20): created successfully Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637c55d8-13ba-4c0b-adbf-efe239b38592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Flow 'volume_create_manager' (dc2c87e0-7cb6-4be0-9193-7767126aeab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e4777-de39-4a86-b2ab-ce409d2227ed]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-91946847-228d-475d-8dbd-bc34e3c77947 tempest-VolumesNegativeTest-721770252 None] Created volume successfully. Jul 09 09:24:01 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:24:01 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:02 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57242553-b4a4-4598-823b-88896fcd86a0" returned: 0 in 0.848s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-57242553-b4a4-4598-823b-88896fcd86a0" released by "delete_volume" :: held 1.882s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Created reservations ['05c81119-547d-4c79-9c4e-cc080feab3c5', '49dcdb83-9bf5-4266-8c18-09bd9f21a37b', '972c7e44-b1b7-4021-9ed0-b681a782a111', '7d4732b3-6d71-4e7e-a359-6e3a92cad0e2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:02 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:02 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-335e2dcf-2b14-4f97-baaa-3423b7dbdb14-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "cinder-335e2dcf-2b14-4f97-baaa-3423b7dbdb14-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:02 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 1.040s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:02 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c 1G Jul 09 09:24:02 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Acquiring lock "cinder-quobyte-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eefb162-90ee-466f-9e15-7ebb14c8241d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:03 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 Jul 09 09:24:03 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:03 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.025s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:03 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Deleted volume successfully. Jul 09 09:24:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3a3dbdf3-fa9f-49c5-8b71-8f1e47226bd6 tempest-VolumesTestJSON-947768569 None] Lock "cinder-57242553-b4a4-4598-823b-88896fcd86a0-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:04 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c 1G" returned: 0 in 1.245s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:04 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c Jul 09 09:24:04 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:04 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" returned: 0 in 1.179s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:04 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14 Jul 09 09:24:04 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:04 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:04 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c is being set with open permissions: ugo+rw Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:04 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c Jul 09 09:24:04 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:04 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "cinder-quobyte-335e2dcf-2b14-4f97-baaa-3423b7dbdb14" released by "delete_volume" :: held 1.945s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Created reservations ['a6eea0aa-421e-40b0-bbc9-f203620dce0d', '2469eb45-e08a-4b32-a432-ad762d1ab387', 'b11f5416-cd2b-4fbb-a1d9-7aa4b84d7c96', '96a72424-1020-4624-badd-3def5729e9f2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:05 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:05 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:05 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c" returned: 0 in 0.800s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.987s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-73847ec9-6591-419e-b4b6-6fc017749be5 tempest-VolumesSnapshotListTestJSON-1745794145 None] Create snapshot completed successfully Jul 09 09:24:06 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.002s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Deleted volume successfully. Jul 09 09:24:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a327c366-b026-4920-9e56-97ff079dd937 tempest-VolumesTestJSON-947768569 None] Lock "cinder-335e2dcf-2b14-4f97-baaa-3423b7dbdb14-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-7e0873d0-01b5-4e35-9366-e70e9f556f2c-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-7e0873d0-01b5-4e35-9366-e70e9f556f2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-7e0873d0-01b5-4e35-9366-e70e9f556f2c" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-7e0873d0-01b5-4e35-9366-e70e9f556f2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Deleting offline snapshot 7e0873d0-01b5-4e35-9366-e70e9f556f2c of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] snapshot_file for this snap is: volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b4bc8-f8e7-4b85-83e7-7974d60e0ff2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:07 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c Jul 09 09:24:07 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:08 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c" returned: 0 in 0.822s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6138807-a577-4944-855e-0bf5afc4c19c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:08 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:24:08 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:09 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 0.895s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:09 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c Jul 09 09:24:09 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:10 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c" returned: 0 in 0.992s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:10 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c Jul 09 09:24:10 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:11 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.7e0873d0-01b5-4e35-9366-e70e9f556f2c" returned: 0 in 0.791s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-7e0873d0-01b5-4e35-9366-e70e9f556f2c" released by "_delete_snapshot" :: held 3.621s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" released by "delete_snapshot" :: held 3.644s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Created reservations ['39ebedd7-caea-4f9e-bc12-1c924ace138f', 'b98f818a-f61f-42c1-b5f8-747f690e65c7', 'adbd8b64-87b7-4f05-978f-262b703dc14d', 'f77269cf-37d3-41e0-b69f-7690686bb9ae'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Delete snapshot completed successfully. Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-33c4778c-75e6-40e2-b8c0-5af36d3425a6 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-7e0873d0-01b5-4e35-9366-e70e9f556f2c-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-42150d64-889b-4ad9-8fd0-9ba8c770bf3b-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-42150d64-889b-4ad9-8fd0-9ba8c770bf3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-42150d64-889b-4ad9-8fd0-9ba8c770bf3b" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-42150d64-889b-4ad9-8fd0-9ba8c770bf3b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Deleting offline snapshot 42150d64-889b-4ad9-8fd0-9ba8c770bf3b of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] snapshot_file for this snap is: volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690ab73-4057-44ca-a234-89d2d6010ce6]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:11 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:24:11 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:12 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 0.843s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:12 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ae610-5452-4f9e-a00e-96f07161b09c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:12 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:24:12 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:13 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 0.853s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:13 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:24:13 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:14 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 1.174s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:14 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b Jul 09 09:24:14 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:15 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.42150d64-889b-4ad9-8fd0-9ba8c770bf3b" returned: 0 in 0.841s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-42150d64-889b-4ad9-8fd0-9ba8c770bf3b" released by "_delete_snapshot" :: held 3.819s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" released by "delete_snapshot" :: held 3.854s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Created reservations ['e52bf324-1d7b-4183-9548-8cc104d673c2', '3f4e10cc-96ba-46e6-83c8-f208a72d4a68', 'c1ea5348-98d0-4a01-ac05-42473ba96e52', 'b749b7dc-9dc8-4bc7-8a46-2a940daf7722'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Delete snapshot completed successfully. Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ee353a7a-8e0b-419e-9c6e-7f3820877b07 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-42150d64-889b-4ad9-8fd0-9ba8c770bf3b-delete_snapshot" released by "delete_snapshot" :: held 4.057s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-e163b294-0a2c-4c22-a503-eaf8a86aa1d7-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-e163b294-0a2c-4c22-a503-eaf8a86aa1d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-e163b294-0a2c-4c22-a503-eaf8a86aa1d7" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-e163b294-0a2c-4c22-a503-eaf8a86aa1d7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Deleting offline snapshot e163b294-0a2c-4c22-a503-eaf8a86aa1d7 of volume a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] snapshot_file for this snap is: volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2c426-fbca-496d-9c1d-b8cf856b9cd1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:16 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:24:16 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:17 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 0.919s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:24:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f03f80b-7224-4632-930b-6e19b0dded38]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:17 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 Jul 09 09:24:17 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:18 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556" returned: 0 in 1.257s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:18 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:24:18 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:19 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 1.071s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:19 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7 Jul 09 09:24:19 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:20 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556.e163b294-0a2c-4c22-a503-eaf8a86aa1d7" returned: 0 in 1.425s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-e163b294-0a2c-4c22-a503-eaf8a86aa1d7" released by "_delete_snapshot" :: held 4.852s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" released by "delete_snapshot" :: held 4.904s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Created reservations ['7da2ca03-b3a4-4c17-b3ed-c8401f786c06', '05063648-13c8-4ce7-a7b1-3ff18a38930e', 'c487f08b-4ee9-44e0-98bf-bc4c7933495f', 'c5788d6b-9763-4ec9-9637-68a07f7b30e2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Delete snapshot completed successfully. Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ba5c5cc3-bd2d-4b8a-bb61-ecd74ea734a8 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-e163b294-0a2c-4c22-a503-eaf8a86aa1d7-delete_snapshot" released by "delete_snapshot" :: held 5.172s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-a531623f-1af6-4d8b-8542-aa7c7c5f2556-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-a531623f-1af6-4d8b-8542-aa7c7c5f2556-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" acquired by "delete_volume" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f56a6d-4da4-46e9-aa11-3182ed7445dc]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:22 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 Jul 09 09:24:22 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:22 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556" returned: 0 in 1.127s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:22 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556 Jul 09 09:24:22 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:23 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a531623f-1af6-4d8b-8542-aa7c7c5f2556" returned: 0 in 0.846s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-quobyte-a531623f-1af6-4d8b-8542-aa7c7c5f2556" released by "delete_volume" :: held 2.059s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:23 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Created reservations ['507712c3-b7bb-4893-b5f9-70a4c3375ada', '62385236-fa0e-4856-9599-c4c042de4206', '789830e3-2dcf-446e-a53c-09fefaf182b3', '78acb821-69bb-4947-915e-4cfc06e2ca55'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:24 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:24 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:24 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.719s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Deleted volume successfully. Jul 09 09:24:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-635664b7-d51a-4e35-a62d-efe1ef976cc0 tempest-VolumesSnapshotListTestJSON-1745794145 None] Lock "cinder-a531623f-1af6-4d8b-8542-aa7c7c5f2556-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:30 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:24:30 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=59,cinder:UPDATE=75,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:24:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-cf740a87-93e7-4a50-a7c7-fb5cc115853f req-23420efe-6e20-45e0-8a1b-79f15a612267 tempest-AttachVolumeNegativeTest-689033810 None] Terminate volume connection completed successfully. Jul 09 09:24:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-cf740a87-93e7-4a50-a7c7-fb5cc115853f req-23420efe-6e20-45e0-8a1b-79f15a612267 tempest-AttachVolumeNegativeTest-689033810 None] Deleting attachment d1d0c771-c750-4733-bad2-1d859c6c0538. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Flow 'volume_create_manager' (7f5fdd68-1a88-4f15-820d-274b6c291ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21cf76e-56ee-4a75-bcff-8dfcd3f9dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21cf76e-56ee-4a75-bcff-8dfcd3f9dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1794716429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1636c3-2573-418a-b7cd-07accbafccf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564f0245294d4bc4bbf0dae47cca0a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:35Z,use_quota=True,user_id='5f22f02fb7c2423698cd2f1ca1ed249f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd166b0b-4b2a-48cf-9620-fde32b7aa31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd166b0b-4b2a-48cf-9620-fde32b7aa31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b982f373-e99f-4365-bd7a-0fe701560d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b982f373-e99f-4365-bd7a-0fe701560d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1636c3-2573-418a-b7cd-07accbafccf2', 'volume_name': 'volume-cc1636c3-2573-418a-b7cd-07accbafccf2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373ae5aa-bf06-45d8-8efb-cf721b02fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373ae5aa-bf06-45d8-8efb-cf721b02fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59d4e82-5add-4f09-9b87-ccba48deb405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Volume cc1636c3-2573-418a-b7cd-07accbafccf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1636c3-2573-418a-b7cd-07accbafccf2', 'volume_size': 1} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1794716429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1636c3-2573-418a-b7cd-07accbafccf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564f0245294d4bc4bbf0dae47cca0a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:35Z,use_quota=True,user_id='5f22f02fb7c2423698cd2f1ca1ed249f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Creating volume cc1636c3-2573-418a-b7cd-07accbafccf2 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:24:35 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:24:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:35 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 1073741824 Jul 09 09:24:35 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:36 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 1073741824" returned: 0 in 1.099s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:36 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 Jul 09 09:24:36 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:37 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2" returned: 0 in 0.861s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59d4e82-5add-4f09-9b87-ccba48deb405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1636c3-2573-418a-b7cd-07accbafccf2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21651de-02f9-4bbe-974e-e3a5e019cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Volume volume-cc1636c3-2573-418a-b7cd-07accbafccf2 (cc1636c3-2573-418a-b7cd-07accbafccf2): created successfully Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21651de-02f9-4bbe-974e-e3a5e019cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Flow 'volume_create_manager' (7f5fdd68-1a88-4f15-820d-274b6c291ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-495aea3b-1eee-4f36-ab32-962ff8ab99d2 tempest-VolumesServicesTestJSON-1778131254 None] Created volume successfully. Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Acquiring lock "cinder-9720291f-197d-42ed-9ef9-fd8b1dab2b20-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "cinder-9720291f-197d-42ed-9ef9-fd8b1dab2b20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Acquiring lock "cinder-quobyte-9720291f-197d-42ed-9ef9-fd8b1dab2b20" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "cinder-quobyte-9720291f-197d-42ed-9ef9-fd8b1dab2b20" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a29f44-b052-4026-9137-71694a48c45a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:37 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 Jul 09 09:24:37 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Acquiring lock "cinder-cc1636c3-2573-418a-b7cd-07accbafccf2-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "cinder-cc1636c3-2573-418a-b7cd-07accbafccf2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Acquiring lock "cinder-quobyte-cc1636c3-2573-418a-b7cd-07accbafccf2" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "cinder-quobyte-cc1636c3-2573-418a-b7cd-07accbafccf2" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac4ba7-55d2-4d55-a59c-f19d2faf3e23]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:38 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 Jul 09 09:24:38 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:38 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20" returned: 0 in 0.852s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:38 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20 Jul 09 09:24:38 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:39 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9720291f-197d-42ed-9ef9-fd8b1dab2b20" returned: 0 in 0.714s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:39 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2" returned: 0 in 0.878s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "cinder-quobyte-9720291f-197d-42ed-9ef9-fd8b1dab2b20" released by "delete_volume" :: held 1.656s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:39 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2 Jul 09 09:24:39 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Created reservations ['1e53da84-815c-4487-8a59-75bdfa7392be', 'a16594da-1b85-4360-a96a-1f6ffe007187', '3f478b3a-7ea5-4b22-857d-2b5a943a147d', '50925512-d2b8-4f58-8740-71d7f66d8a24'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:39 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:39 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:40 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cc1636c3-2573-418a-b7cd-07accbafccf2" returned: 0 in 0.970s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "cinder-quobyte-cc1636c3-2573-418a-b7cd-07accbafccf2" released by "delete_volume" :: held 1.906s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:40 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Deleted volume successfully. Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1e010f8f-5e56-4b3f-9985-a8352f2d225e tempest-VolumesNegativeTest-721770252 None] Lock "cinder-9720291f-197d-42ed-9ef9-fd8b1dab2b20-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Created reservations ['3903a5ea-c601-4f49-9d10-67dfbe9ba817', '913e4f4e-7377-4162-8420-079a31e6fbd0', 'd225877a-ead5-4a76-a809-e3435198d484', 'e4788d99-692e-4fcb-a79f-08e405dc6821'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:40 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:40 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:41 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.982s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:41 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Deleted volume successfully. Jul 09 09:24:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-58371671-3c0e-4c6a-a1c6-106ca8f5fd5c tempest-VolumesServicesTestJSON-1778131254 None] Lock "cinder-cc1636c3-2573-418a-b7cd-07accbafccf2-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Flow 'volume_create_manager' (79c7be13-8e49-49a4-a232-4aaf80d8c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3649c3e7-9638-42f3-a17f-ef1ddb0d0345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3649c3e7-9638-42f3-a17f-ef1ddb0d0345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1769990220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0120b4f3-e027-4802-b503-83a335121fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c0fdcd58cd45299a2bb0b7f5a18cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:49Z,use_quota=True,user_id='5541fc3dd35644d5a376f754657e7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ac4c0-a81d-412b-b0ad-d5819ba750d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ac4c0-a81d-412b-b0ad-d5819ba750d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba180f9-e2ff-461d-8645-b705549badb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba180f9-e2ff-461d-8645-b705549badb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0120b4f3-e027-4802-b503-83a335121fc9', 'volume_name': 'volume-0120b4f3-e027-4802-b503-83a335121fc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2fb0c-fb32-42ae-a8c6-0a71bbcab5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2fb0c-fb32-42ae-a8c6-0a71bbcab5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d17a04-5733-4bd5-a039-cd2e65d850d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Volume 0120b4f3-e027-4802-b503-83a335121fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0120b4f3-e027-4802-b503-83a335121fc9', 'volume_size': 1} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1769990220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0120b4f3-e027-4802-b503-83a335121fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c0fdcd58cd45299a2bb0b7f5a18cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:49Z,use_quota=True,user_id='5541fc3dd35644d5a376f754657e7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Creating volume 0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:24:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:24:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:48 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 1073741824 Jul 09 09:24:48 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:49 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 1073741824" returned: 0 in 0.969s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:49 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 Jul 09 09:24:49 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:50 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9" returned: 0 in 0.725s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d17a04-5733-4bd5-a039-cd2e65d850d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0120b4f3-e027-4802-b503-83a335121fc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdecf82d-6b7a-4491-8af3-35da379d983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Volume volume-0120b4f3-e027-4802-b503-83a335121fc9 (0120b4f3-e027-4802-b503-83a335121fc9): created successfully Jul 09 09:24:50 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:24:50 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdecf82d-6b7a-4491-8af3-35da379d983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Flow 'volume_create_manager' (79c7be13-8e49-49a4-a232-4aaf80d8c85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4603f0de-3801-49fb-b969-6edd1bcb8203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Created volume successfully. Jul 09 09:24:51 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.872s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:24:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:24:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:24:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Creating offline snapshot 3746e73c-8983-40a5-8752-cbc2b301672a of volume 0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23449a-06fc-431f-b8f1-99ceb1a792b9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:52 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 Jul 09 09:24:52 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:52 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9" returned: 0 in 0.858s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:53 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a 1G Jul 09 09:24:53 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:53 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a 1G" returned: 0 in 0.885s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0120b4f3-e027-4802-b503-83a335121fc9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:53 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0120b4f3-e027-4802-b503-83a335121fc9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a Jul 09 09:24:53 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:54 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0120b4f3-e027-4802-b503-83a335121fc9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a" returned: 0 in 0.841s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:54 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a is being set with open permissions: ugo+rw Jul 09 09:24:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:54 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a Jul 09 09:24:54 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:55 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a" returned: 0 in 1.163s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:55 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info Jul 09 09:24:55 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (9d914d4c-f86c-4179-b734-2975745bc07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cab2ade-8471-4be9-bf90-8d7f8cbdc5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cab2ade-8471-4be9-bf90-8d7f8cbdc5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1664603811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed2340-108b-4a32-9da5-fa536cff4ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:56Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d536dfa-05eb-4c40-b63c-2c40d1e8f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d536dfa-05eb-4c40-b63c-2c40d1e8f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c20717-5ec1-435d-a1c3-5e2bd9e6eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c20717-5ec1-435d-a1c3-5e2bd9e6eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ed2340-108b-4a32-9da5-fa536cff4ff1', 'volume_name': 'volume-92ed2340-108b-4a32-9da5-fa536cff4ff1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ab2671-8446-41bf-9915-417d35f6fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ab2671-8446-41bf-9915-417d35f6fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a89014b-d6f0-419d-ae45-f0e6ab10c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Volume 92ed2340-108b-4a32-9da5-fa536cff4ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ed2340-108b-4a32-9da5-fa536cff4ff1', 'volume_size': 1} Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:56 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info" returned: 0 in 0.911s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:56 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info is being set with open permissions: ugo+rw Jul 09 09:24:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:56 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info Jul 09 09:24:56 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:57 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.info" returned: 0 in 0.808s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.620s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1664603811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed2340-108b-4a32-9da5-fa536cff4ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:56Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Creating volume 92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:24:57 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:24:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:57 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 1073741824 Jul 09 09:24:57 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-57e5b474-1f6d-4a40-a1f9-3038b2668cca tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Create snapshot completed successfully Jul 09 09:24:58 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 1073741824" returned: 0 in 0.937s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:58 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 Jul 09 09:24:58 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "cinder-3746e73c-8983-40a5-8752-cbc2b301672a-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-3746e73c-8983-40a5-8752-cbc2b301672a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "cinder-quobyte-3746e73c-8983-40a5-8752-cbc2b301672a" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-3746e73c-8983-40a5-8752-cbc2b301672a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Deleting offline snapshot 3746e73c-8983-40a5-8752-cbc2b301672a of volume 0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] snapshot_file for this snap is: volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef75cd-8781-43a5-a8c0-b2695ad23c0c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:24:59 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a Jul 09 09:24:59 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:24:59 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1" returned: 0 in 0.828s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a89014b-d6f0-419d-ae45-f0e6ab10c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ed2340-108b-4a32-9da5-fa536cff4ff1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9d34a-ac2b-4937-a0f2-87e2e713b053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:24:59 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Volume volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 (92ed2340-108b-4a32-9da5-fa536cff4ff1): created successfully Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9d34a-ac2b-4937-a0f2-87e2e713b053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (9d914d4c-f86c-4179-b734-2975745bc07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:24:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ef3d8c31-e5c3-47e1-a18b-eb1816339893 tempest-VolumesSnapshotTestJSON-937547723 None] Created volume successfully. Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:24:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Creating offline snapshot d5713278-88ff-4ad0-b987-50a9ecf929ff of volume 92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf95c81-6b7a-4f16-bcec-048d2eb76d0e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:00 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a" returned: 0 in 0.942s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0120b4f3-e027-4802-b503-83a335121fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[24617279-2358-42b3-9f9e-100a64901c66]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:00 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 Jul 09 09:25:00 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:00 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 Jul 09 09:25:00 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:00 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9" returned: 0 in 0.853s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:00 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1" returned: 0 in 0.921s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:00 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a Jul 09 09:25:00 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:00 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff 1G Jul 09 09:25:00 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:01 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a" returned: 0 in 1.012s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:01 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a Jul 09 09:25:01 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:02 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff 1G" returned: 0 in 1.249s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:02 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff Jul 09 09:25:02 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:02 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9.3746e73c-8983-40a5-8752-cbc2b301672a" returned: 0 in 0.965s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-3746e73c-8983-40a5-8752-cbc2b301672a" released by "_delete_snapshot" :: held 3.920s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" released by "delete_snapshot" :: held 3.955s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Created reservations ['0e93165f-0b06-4d3b-8a71-438df7ad58c4', '5e746495-1f0b-40d3-870f-8664897d9a77', 'ffc30cb7-9870-426e-b0a9-457548f8aa9d', 'b6d67b5e-5c1a-4395-9610-8f261e8922d3'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Delete snapshot completed successfully. Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-eb367d07-da86-4538-ae08-45a1d5ff5fa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-3746e73c-8983-40a5-8752-cbc2b301672a-delete_snapshot" released by "delete_snapshot" :: held 4.119s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:03 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff" returned: 0 in 1.023s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:03 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff is being set with open permissions: ugo+rw Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:03 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff Jul 09 09:25:03 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "cinder-0120b4f3-e027-4802-b503-83a335121fc9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-0120b4f3-e027-4802-b503-83a335121fc9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb645ad-e8fd-42fe-98f5-bf174c0a0443]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:03 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 Jul 09 09:25:03 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:04 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff" returned: 0 in 0.873s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:04 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info Jul 09 09:25:04 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:04 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9" returned: 0 in 0.926s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:04 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9 Jul 09 09:25:04 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:04 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info" returned: 0 in 0.692s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:04 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info is being set with open permissions: ugo+rw Jul 09 09:25:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:04 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info Jul 09 09:25:04 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:05 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0120b4f3-e027-4802-b503-83a335121fc9" returned: 0 in 0.795s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-quobyte-0120b4f3-e027-4802-b503-83a335121fc9" released by "delete_volume" :: held 1.808s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Created reservations ['0883d12c-cd12-424a-84a2-6ddabc0a0dd3', '9491aafe-10d0-4838-a093-d96054ab93bf', 'ac388ae5-00e1-4f86-93f9-a138ce69d8cc', 'c0599f90-8bb9-484d-b59b-3290827e31a0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:05 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:25:05 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:05 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.info" returned: 0 in 0.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.652s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-14337841-5c60-41ef-bcb4-190cb1021508 tempest-VolumesSnapshotTestJSON-937547723 None] Create snapshot completed successfully Jul 09 09:25:06 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.854s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:25:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Deleted volume successfully. Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ec83fdb8-6d57-40eb-8ab6-2030b60fdbe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1020762475 None] Lock "cinder-0120b4f3-e027-4802-b503-83a335121fc9-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-d5713278-88ff-4ad0-b987-50a9ecf929ff-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-d5713278-88ff-4ad0-b987-50a9ecf929ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-d5713278-88ff-4ad0-b987-50a9ecf929ff" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-d5713278-88ff-4ad0-b987-50a9ecf929ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Deleting offline snapshot d5713278-88ff-4ad0-b987-50a9ecf929ff of volume 92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] snapshot_file for this snap is: volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d545ef-9dad-42d1-acac-06964f3afe27]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:07 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff Jul 09 09:25:07 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:08 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff" returned: 0 in 1.476s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92ed2340-108b-4a32-9da5-fa536cff4ff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:25:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff253e-ab05-4228-9146-65df8adc1ea8]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:08 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 Jul 09 09:25:08 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:10 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1" returned: 0 in 1.679s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:10 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff Jul 09 09:25:10 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:11 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff" returned: 0 in 1.125s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:11 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff Jul 09 09:25:11 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:12 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1.d5713278-88ff-4ad0-b987-50a9ecf929ff" returned: 0 in 1.015s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-d5713278-88ff-4ad0-b987-50a9ecf929ff" released by "_delete_snapshot" :: held 5.478s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" released by "delete_snapshot" :: held 5.507s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['5ddbee8d-671c-4456-9707-88fc1d43357e', '6e4e9fec-d0f2-419d-acea-8477b09c7559', 'ea63d867-9d33-416c-a102-54474a66b857', '383131a7-5603-40d3-85ff-a614df41213d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Delete snapshot completed successfully. Jul 09 09:25:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06219bcf-bfdb-4832-8449-bedd6923d3b5 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-d5713278-88ff-4ad0-b987-50a9ecf929ff-delete_snapshot" released by "delete_snapshot" :: held 5.774s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (ef3bfb28-ca42-427d-b08d-4c25a016ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ad6a1-a14d-4067-bbe6-a0c36ce169f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ad6a1-a14d-4067-bbe6-a0c36ce169f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-387504871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6d1c82-1f95-4b08-b22a-fd547cf3068a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:15Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184c7204-626f-4362-b5b7-19aa0572bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184c7204-626f-4362-b5b7-19aa0572bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904ee842-e845-4045-9c98-a4fa73b4bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904ee842-e845-4045-9c98-a4fa73b4bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6d1c82-1f95-4b08-b22a-fd547cf3068a', 'volume_name': 'volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c0bc61-66bc-46d4-ba63-2ef91a6277d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c0bc61-66bc-46d4-ba63-2ef91a6277d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4c4d2b-a728-4f61-9da2-21475fb6917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Volume ef6d1c82-1f95-4b08-b22a-fd547cf3068a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a', 'volume_size': 1} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-387504871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6d1c82-1f95-4b08-b22a-fd547cf3068a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:15Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Creating volume ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:14 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:14 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a 1073741824 Jul 09 09:25:14 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Flow 'volume_create_manager' (3452c93c-5d93-415c-ae7c-06fb68371c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65386b9-2bd3-4879-9bff-ffd8135eb57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65386b9-2bd3-4879-9bff-ffd8135eb57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1345387560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a10fbd7-08b1-443b-a713-6361919a7f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2b9d0b9e4844aa832807e7c28aac5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:15Z,use_quota=True,user_id='916cbbd19bf4435d8397dafd98f13b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcfd08d-66b9-489f-8a84-693ad217d44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcfd08d-66b9-489f-8a84-693ad217d44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755bb0c-d7ae-496b-8ab8-7e84c4a8ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755bb0c-d7ae-496b-8ab8-7e84c4a8ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a10fbd7-08b1-443b-a713-6361919a7f56', 'volume_name': 'volume-1a10fbd7-08b1-443b-a713-6361919a7f56', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d4064f-8dbe-4c65-8f23-b4dcfc058dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d4064f-8dbe-4c65-8f23-b4dcfc058dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a13ba4b-2e66-4506-a890-2d3b8f6ae7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:15 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Volume 1a10fbd7-08b1-443b-a713-6361919a7f56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a10fbd7-08b1-443b-a713-6361919a7f56', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 09:25:15 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Trying to clone 1a10fbd7-08b1-443b-a713-6361919a7f56 from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:25:16 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:25:16 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Image download 20.69 MB at 20.69 MB/s Jul 09 09:25:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadd7767-e70d-4a64-a53e-ceee19c4f05d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:16 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a 1073741824" returned: 0 in 1.917s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:16 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD Jul 09 09:25:16 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:16 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:16 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:18 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD" returned: 0 in 1.510s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 is fetched for user 916cbbd19bf4435d8397dafd98f13b4d. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5003606-56f8-4242-bbc6-4d7edfd472ef]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:18 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 1.585s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] <== create_volume: return (3606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.609s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:18 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD Jul 09 09:25:18 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4c4d2b-a728-4f61-9da2-21475fb6917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd8d9b-a20c-4c36-ac3e-0191325ca1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:18 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Volume volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a (ef6d1c82-1f95-4b08-b22a-fd547cf3068a): created successfully Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd8d9b-a20c-4c36-ac3e-0191325ca1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (ef3bfb28-ca42-427d-b08d-4c25a016ee17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9b651f0d-65d5-4df7-b07f-6aa05a192406 tempest-VolumesSnapshotTestJSON-937547723 None] Created volume successfully. Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Creating offline snapshot dfa47e9e-9d86-45c1-98ea-02654028f3eb of volume ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:25:19 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD" returned: 0 in 1.290s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4379097e-d747-4099-8e88-5f63ef8b645a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:19 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:19 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:20 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 1.098s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:20 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb 1G Jul 09 09:25:20 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Flow 'volume_create_manager' (7c0f498e-044e-4d60-8847-93fd921025b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0f0eb3-651e-466f-bb2e-fa917b34729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0f0eb3-651e-466f-bb2e-fa917b34729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-638667652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f473804-be1c-405e-b216-2486d7bf80cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16866ff57a044f8495bc974c920d8321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:21Z,use_quota=True,user_id='a652e9861d984310a823e9c9e4514ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef0a82e-eb4b-4eb2-aefb-191974eda07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef0a82e-eb4b-4eb2-aefb-191974eda07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbad2b3-5d92-4218-8bc4-42030ecd08e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbad2b3-5d92-4218-8bc4-42030ecd08e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f473804-be1c-405e-b216-2486d7bf80cd', 'volume_name': 'volume-2f473804-be1c-405e-b216-2486d7bf80cd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138d2519-9eb2-4fcf-a65e-8eb2c6e9aedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138d2519-9eb2-4fcf-a65e-8eb2c6e9aedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c98f95-be3e-487d-a231-3add6668be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Volume 2f473804-be1c-405e-b216-2486d7bf80cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f473804-be1c-405e-b216-2486d7bf80cd', 'volume_size': 1} Jul 09 09:25:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:21 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb 1G" returned: 0 in 0.962s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:21 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:21 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:22 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.787s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:22 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb is being set with open permissions: ugo+rw Jul 09 09:25:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:22 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:22 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:23 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:23 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info Jul 09 09:25:23 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:23 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info" returned: 0 in 0.825s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:23 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info is being set with open permissions: ugo+rw Jul 09 09:25:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:24 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info Jul 09 09:25:24 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:24 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.info" returned: 0 in 0.723s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.210s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1345387560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a10fbd7-08b1-443b-a713-6361919a7f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2b9d0b9e4844aa832807e7c28aac5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:15Z,use_quota=True,user_id='916cbbd19bf4435d8397dafd98f13b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Creating volume 1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:24 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1073741824 Jul 09 09:25:24 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7891226b-4fdc-4c77-8c15-1855c5ae9638 tempest-VolumesSnapshotTestJSON-937547723 None] Create snapshot completed successfully Jul 09 09:25:25 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1073741824" returned: 0 in 0.926s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:25 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:25 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:26 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 0 in 0.714s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.694s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-638667652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f473804-be1c-405e-b216-2486d7bf80cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16866ff57a044f8495bc974c920d8321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:21Z,use_quota=True,user_id='a652e9861d984310a823e9c9e4514ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Creating volume 2f473804-be1c-405e-b216-2486d7bf80cd {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:26 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:26 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd 1073741824 Jul 09 09:25:26 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Attempting download of 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 1a10fbd7-08b1-443b-a713-6361919a7f56. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (f5267a1f-57a0-4835-87db-85ec86627db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e56601-748e-4775-90e3-07425dcd49c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e56601-748e-4775-90e3-07425dcd49c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815834178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781aaec0-3785-431a-bcd1-8508c4ce1108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dfa47e9e-9d86-45c1-98ea-02654028f3eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:26Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a8c26-e3e3-4ee6-bd4f-cc5f5a9f2791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a8c26-e3e3-4ee6-bd4f-cc5f5a9f2791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ebf22-d82f-45e6-a936-9f70e01c143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ebf22-d82f-45e6-a936-9f70e01c143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '781aaec0-3785-431a-bcd1-8508c4ce1108', 'volume_name': 'volume-781aaec0-3785-431a-bcd1-8508c4ce1108', 'volume_size': 2, 'snapshot_id': 'dfa47e9e-9d86-45c1-98ea-02654028f3eb'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b88649-71bd-4a95-967c-bc809c017a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b88649-71bd-4a95-967c-bc809c017a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe763122-b9b5-4d5d-b3c8-97243977fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Volume 781aaec0-3785-431a-bcd1-8508c4ce1108: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-781aaec0-3785-431a-bcd1-8508c4ce1108', 'volume_size': 2, 'snapshot_id': 'dfa47e9e-9d86-45c1-98ea-02654028f3eb'} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e440c2-a1e8-4525-9029-293c62d5aa5e]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:26 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv Jul 09 09:25:26 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:27 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd 1073741824" returned: 0 in 0.898s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:27 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd Jul 09 09:25:27 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:27 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv" returned: 0 in 0.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:27 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv Jul 09 09:25:27 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:28 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd" returned: 0 in 0.660s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.406s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb-781aaec0-3785-431a-bcd1-8508c4ce1108" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c98f95-be3e-487d-a231-3add6668be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f473804-be1c-405e-b216-2486d7bf80cd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7d7d42-9b14-45b3-a9cb-3b54193adb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Volume volume-2f473804-be1c-405e-b216-2486d7bf80cd (2f473804-be1c-405e-b216-2486d7bf80cd): created successfully Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7d7d42-9b14-45b3-a9cb-3b54193adb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Flow 'volume_create_manager' (7c0f498e-044e-4d60-8847-93fd921025b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb-781aaec0-3785-431a-bcd1-8508c4ce1108" acquired by "_create_volume_from_snapshot" :: waited 0.094s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Creating volume 781aaec0-3785-431a-bcd1-8508c4ce1108 from snapshot dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-46af71fb-9c3a-489f-a7f7-131786578b27 tempest-TestMinimumBasicScenario-1342121504 None] Created volume successfully. Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] snapshot: dfa47e9e-9d86-45c1-98ea-02654028f3eb, volume: 781aaec0-3785-431a-bcd1-8508c4ce1108, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:28 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b28bd3-02cc-49e5-9751-aad8effc9452]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv" returned: 1 in 0.764s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_qa8ga5mv' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61d32c-38b4-4b44-a89d-853197de5d7e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:28 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:28 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:28 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD Jul 09 09:25:28 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:29 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.768s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643a432-32be-488c-a268-8282ef54435c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:29 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] 7c391f23-175f-4461-b6ef-8981ab0baaf6 was qcow2, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:25:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:29 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:29 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:29 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:29 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:30 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 0.923s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:30 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:25:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:30 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 Jul 09 09:25:30 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:31 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 0 in 2.828s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:31 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_gbhgxaeodevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:25:32 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Converted 112.00 MB image at 39.59 MB/s Jul 09 09:25:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:32 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1G Jul 09 09:25:32 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:34 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 1G" returned: 0 in 2.038s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b0f49-3cb8-4908-b313-50214a94e065]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=64,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=16 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=70,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=7 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:25:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:34 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:34 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:35 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 0 in 1.568s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:36 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:36 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:36 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108" returned: 0 in 6.473s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03dedb9-6a5d-4766-a7a2-2feb23787bf7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:36 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:36 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:36 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (21b2d1be-e79b-411b-b299-abe119e8714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be65c108-d464-44ed-9727-0bd9eb3dab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be65c108-d464-44ed-9727-0bd9eb3dab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-398389488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81555772-183d-43f8-b795-6203b930bb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:37Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ebce80-d067-45c7-98e6-ea5841a3fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ebce80-d067-45c7-98e6-ea5841a3fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899a283e-e7a6-4019-bfba-18dacc64f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899a283e-e7a6-4019-bfba-18dacc64f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81555772-183d-43f8-b795-6203b930bb58', 'volume_name': 'volume-81555772-183d-43f8-b795-6203b930bb58', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb6e044-8e52-489c-9366-472cffa35e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb6e044-8e52-489c-9366-472cffa35e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdc66a-be85-441a-91c6-ec0acf5c5ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Volume 81555772-183d-43f8-b795-6203b930bb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81555772-183d-43f8-b795-6203b930bb58', 'volume_size': 1} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 1 in 1.341s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Downloaded image 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 1a10fbd7-08b1-443b-a713-6361919a7f56 successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 for user 916cbbd19bf4435d8397dafd98f13b4d is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Marking volume 1a10fbd7-08b1-443b-a713-6361919a7f56 as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Copying metadata from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 to 1a10fbd7-08b1-443b-a713-6361919a7f56. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Creating volume glance metadata for volume 1a10fbd7-08b1-443b-a713-6361919a7f56 backed by image 7c391f23-175f-4461-b6ef-8981ab0baaf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a13ba4b-2e66-4506-a890-2d3b8f6ae7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a10fbd7-08b1-443b-a713-6361919a7f56', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f146c0ac-40df-4b31-9d6d-89e7ba29acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Volume volume-1a10fbd7-08b1-443b-a713-6361919a7f56 (1a10fbd7-08b1-443b-a713-6361919a7f56): created successfully Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f146c0ac-40df-4b31-9d6d-89e7ba29acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Flow 'volume_create_manager' (3452c93c-5d93-415c-ae7c-06fb68371c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3d692f86-2dc8-4c8b-afb8-b8daf7e209ae tempest-VolumesImageMetadata-797963258 None] Created volume successfully. Jul 09 09:25:37 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 1.117s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:25:37 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Converted 1024.00 MB image at 158.18 MB/s Jul 09 09:25:37 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 is being set with open permissions: ugo+rw Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:37 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 Jul 09 09:25:37 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Acquiring lock "cinder-1a10fbd7-08b1-443b-a713-6361919a7f56-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "cinder-1a10fbd7-08b1-443b-a713-6361919a7f56-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Acquiring lock "cinder-quobyte-1a10fbd7-08b1-443b-a713-6361919a7f56" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "cinder-quobyte-1a10fbd7-08b1-443b-a713-6361919a7f56" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c619c8-33c7-4784-a3cd-077dd6ad6c1d]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:38 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:38 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:38 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" released by "_copy_volume_from_snapshot" :: held 10.144s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb-781aaec0-3785-431a-bcd1-8508c4ce1108" released by "_create_volume_from_snapshot" :: held 10.209s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.305s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.862s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37bc6e6-87e9-4f21-af80-e909a1523324]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe763122-b9b5-4d5d-b3c8-97243977fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781aaec0-3785-431a-bcd1-8508c4ce1108', 'volume_size': 2, 'snapshot_id': 'dfa47e9e-9d86-45c1-98ea-02654028f3eb'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ad4a16-ac13-48f9-9a0d-0049431b6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Volume volume-781aaec0-3785-431a-bcd1-8508c4ce1108 (781aaec0-3785-431a-bcd1-8508c4ce1108): created successfully Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ad4a16-ac13-48f9-9a0d-0049431b6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (f5267a1f-57a0-4835-87db-85ec86627db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3ee21401-a556-4c9a-82ff-a8f4e31ceb48 tempest-VolumesSnapshotTestJSON-937547723 None] Created volume successfully. Jul 09 09:25:38 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd Jul 09 09:25:38 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:38 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 0 in 0.780s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:38 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:38 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-781aaec0-3785-431a-bcd1-8508c4ce1108-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:39 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd" returned: 0 in 0.830s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-781aaec0-3785-431a-bcd1-8508c4ce1108-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.175s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-398389488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81555772-183d-43f8-b795-6203b930bb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:37Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Creating volume 81555772-183d-43f8-b795-6203b930bb58 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:39 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:39 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 1073741824 Jul 09 09:25:39 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-2f473804-be1c-405e-b216-2486d7bf80cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef24516b-34ed-4cc5-9962-1af54fa7a30d', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-3354eb8a-3bd3-4478-b1ea-bfe5a9e86b0f req-65a10f62-4ff7-4dc7-b6eb-153cd49a4614 tempest-TestMinimumBasicScenario-1342121504 None] attachment_update completed successfully. Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f314a6-a4bd-47ae-a01c-fba3ee7c10c9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:39 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 Jul 09 09:25:39 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:39 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 1 in 0.921s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:25:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:39 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56 Jul 09 09:25:39 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:40 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108" returned: 0 in 0.899s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:40 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 1073741824" returned: 0 in 1.075s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:40 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108 Jul 09 09:25:40 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:40 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1a10fbd7-08b1-443b-a713-6361919a7f56" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "cinder-quobyte-1a10fbd7-08b1-443b-a713-6361919a7f56" released by "delete_volume" :: held 2.480s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:40 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 Jul 09 09:25:40 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Created reservations ['4cebb38a-42b5-4e18-9355-b387eebef1cf', 'd4bcfebf-9de5-46fd-a60c-de379528978f', 'acff9a6a-7eb5-4a25-b462-5a38bffeba62', 'b88cdfd3-efe1-447a-ad9d-e89527f89613'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:40 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:25:40 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:41 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-781aaec0-3785-431a-bcd1-8508c4ce1108" returned: 0 in 0.728s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-781aaec0-3785-431a-bcd1-8508c4ce1108" released by "delete_volume" :: held 1.684s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['5973909e-ed73-4544-9a2f-d7600688836a', '2874f5f3-3d9d-4b48-b71a-5dd5a6c4660c', '9ff7714b-4c30-44a4-bbb8-8ea90fc3ec84', '921cdc76-010c-4191-9bd5-1da543cf6e67'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:41 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:25:41 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:41 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58" returned: 0 in 0.941s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdc66a-be85-441a-91c6-ec0acf5c5ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81555772-183d-43f8-b795-6203b930bb58', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022111d8-78c0-4cc5-83b4-443b943d045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:41 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Volume volume-81555772-183d-43f8-b795-6203b930bb58 (81555772-183d-43f8-b795-6203b930bb58): created successfully Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022111d8-78c0-4cc5-83b4-443b943d045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (21b2d1be-e79b-411b-b299-abe119e8714e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2e9901b7-367c-4701-b808-5d412a551000 tempest-AttachVolumeNegativeTest-689033810 None] Created volume successfully. Jul 09 09:25:41 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.848s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:25:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Deleted volume successfully. Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f885a8f5-ffea-4437-914e-b2e344f293ac tempest-VolumesImageMetadata-797963258 None] Lock "cinder-1a10fbd7-08b1-443b-a713-6361919a7f56-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-dfa47e9e-9d86-45c1-98ea-02654028f3eb-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-dfa47e9e-9d86-45c1-98ea-02654028f3eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Deleting offline snapshot dfa47e9e-9d86-45c1-98ea-02654028f3eb of volume ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] snapshot_file for this snap is: volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fe348b-91f7-43f2-b644-73d423dd8f36]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:41 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:41 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:42 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:25:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Deleted volume successfully. Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81b285e8-60b4-41f3-b93b-52f7e2a85372 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-781aaec0-3785-431a-bcd1-8508c4ce1108-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:42 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.896s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f362c4-1ca8-4764-9034-97b086f4aab9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:42 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:42 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:43 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 0.832s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:43 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:43 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:44 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.917s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:44 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb Jul 09 09:25:44 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Flow 'volume_create_manager' (17a1e649-4988-4518-8ecd-c183da929c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108a90af-746b-4754-8c80-2153e4e3d896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108a90af-746b-4754-8c80-2153e4e3d896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-427921257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2a1a93-01d7-4ba7-b19e-d009516d452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38900bf7953c44468ec6ac2b15f082d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:44Z,use_quota=True,user_id='c984809e99cc4eb2854b60d00da08162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c3d55-9977-4a1a-bbbf-5746ee4e3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c3d55-9977-4a1a-bbbf-5746ee4e3816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5c76e-712f-4702-bccc-3fe92445cf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5c76e-712f-4702-bccc-3fe92445cf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2a1a93-01d7-4ba7-b19e-d009516d452e', 'volume_name': 'volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01614533-79fa-4d02-8f12-9f767faa80bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01614533-79fa-4d02-8f12-9f767faa80bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d04f7-2ae5-432b-87ab-34290a8ac318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:44 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Volume 2d2a1a93-01d7-4ba7-b19e-d009516d452e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e', 'volume_size': 1} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-427921257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2a1a93-01d7-4ba7-b19e-d009516d452e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38900bf7953c44468ec6ac2b15f082d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:44Z,use_quota=True,user_id='c984809e99cc4eb2854b60d00da08162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Creating volume 2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:44 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:44 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e 1073741824 Jul 09 09:25:44 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:45 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a.dfa47e9e-9d86-45c1-98ea-02654028f3eb" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-dfa47e9e-9d86-45c1-98ea-02654028f3eb" released by "_delete_snapshot" :: held 3.584s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" released by "delete_snapshot" :: held 3.609s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['3c050060-b5ef-4f8a-bb55-812109938865', 'f98d8039-c92c-45e9-81ed-1fc8ed841097', '741ac896-790e-4322-a2aa-1371be45d463', '46b7d988-6734-41de-875a-c681763bbb31'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Delete snapshot completed successfully. Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31c1af53-c085-4edc-80ab-1c6bec0bd3d7 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-dfa47e9e-9d86-45c1-98ea-02654028f3eb-delete_snapshot" released by "delete_snapshot" :: held 3.810s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:45 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e 1073741824" returned: 0 in 1.070s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:45 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e Jul 09 09:25:45 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-ef6d1c82-1f95-4b08-b22a-fd547cf3068a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-ef6d1c82-1f95-4b08-b22a-fd547cf3068a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[914360ca-6d02-4dbd-9f3f-2ec8cd7101a0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:46 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:46 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:46 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e" returned: 0 in 0.778s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07c582-f44a-4e34-a44f-58fea0f89337]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d04f7-2ae5-432b-87ab-34290a8ac318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e805075-81e1-4fd6-9e6d-74f0008358f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Volume volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e (2d2a1a93-01d7-4ba7-b19e-d009516d452e): created successfully Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e805075-81e1-4fd6-9e6d-74f0008358f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Flow 'volume_create_manager' (17a1e649-4988-4518-8ecd-c183da929c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-45a606bf-deca-407a-9f0a-274393eb1076 tempest-SnapshotMetadataTestJSON-67026950 None] Created volume successfully. Jul 09 09:25:46 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 Jul 09 09:25:46 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:47 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 0.952s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:47 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a Jul 09 09:25:47 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:47 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58" returned: 0 in 1.055s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.076s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-81555772-183d-43f8-b795-6203b930bb58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9a0beb7-3f23-41f8-bd61-38e64acb5e62', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:25:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a3198796-9dd8-4863-a6a4-dd53d8689361 req-ab649dde-2898-4284-9f72-259de5a6beb2 tempest-AttachVolumeNegativeTest-689033810 None] attachment_update completed successfully. Jul 09 09:25:47 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" returned: 0 in 0.882s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-ef6d1c82-1f95-4b08-b22a-fd547cf3068a" released by "delete_volume" :: held 1.965s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['bb09ed5c-f685-44a8-b340-1e5ba0906c24', '1496e3dc-8840-4d27-a6d8-164bcc9328ef', '8a4e60d6-372c-49eb-9bc9-9a7f372994b2', '4e0fc88d-95a2-407e-83f0-ac6233897dd8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Creating offline snapshot 4ab4fd3d-38dd-42d6-8381-a137889bfe81 of volume 2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe30ce4-a810-41bd-8221-65db3e1c7d3e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:48 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:25:48 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:48 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e Jul 09 09:25:48 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:49 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.832s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:25:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Deleted volume successfully. Jul 09 09:25:49 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f6a09e5b-ea0c-4110-992a-e7154ea885f6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-ef6d1c82-1f95-4b08-b22a-fd547cf3068a-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e" returned: 0 in 0.995s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:49 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 1G Jul 09 09:25:49 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:49 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (3871af2d-c86a-4ebd-a567-8802178252da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92eb524-098e-4518-8a5b-d226b4c5874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92eb524-098e-4518-8a5b-d226b4c5874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-267916120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceb04f7-7333-4d97-ba98-8b0eac6aec16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:50Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a91cf8-e24d-4228-8e6b-00a4fa94118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a91cf8-e24d-4228-8e6b-00a4fa94118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472f7578-fc6a-41d2-bf00-fdd2b407968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472f7578-fc6a-41d2-bf00-fdd2b407968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ceb04f7-7333-4d97-ba98-8b0eac6aec16', 'volume_name': 'volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3601e62b-ff68-49cf-ae45-934dd04f25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3601e62b-ff68-49cf-ae45-934dd04f25ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8113367-1da6-4a8c-ae9d-3ebe7ed1c1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Volume 1ceb04f7-7333-4d97-ba98-8b0eac6aec16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16', 'volume_size': 1} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:50 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 1G" returned: 0 in 0.942s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:50 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 Jul 09 09:25:50 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:50 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:25:50 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:50 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81" returned: 0 in 0.827s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:50 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 is being set with open permissions: ugo+rw Jul 09 09:25:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:51 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 Jul 09 09:25:51 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:51 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.818s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:25:51 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81" returned: 0 in 0.705s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:51 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info Jul 09 09:25:51 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:52 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:52 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info is being set with open permissions: ugo+rw Jul 09 09:25:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:52 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info Jul 09 09:25:52 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:53 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.info" returned: 0 in 0.676s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-267916120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceb04f7-7333-4d97-ba98-8b0eac6aec16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:25:50Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Creating volume 1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:25:53 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:53 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 1073741824 Jul 09 09:25:53 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:53 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 1073741824" returned: 0 in 0.826s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-48aa36c1-f600-46f9-abfd-115d46983fd8 tempest-SnapshotMetadataTestJSON-67026950 None] Create snapshot completed successfully Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:57 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:25:57 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:57 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 0.703s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] <== create_volume: return (4846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.850s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8113367-1da6-4a8c-ae9d-3ebe7ed1c1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6d48ea-3a64-4888-8049-b53f2a6324dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:25:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Volume volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 (1ceb04f7-7333-4d97-ba98-8b0eac6aec16): created successfully Jul 09 09:25:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6d48ea-3a64-4888-8049-b53f2a6324dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (3871af2d-c86a-4ebd-a567-8802178252da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:25:58 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-449ea54e-2d0a-4044-ae1d-057f564be4ff tempest-VolumesSnapshotTestJSON-937547723 None] Created volume successfully. Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "cinder-4ab4fd3d-38dd-42d6-8381-a137889bfe81-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-4ab4fd3d-38dd-42d6-8381-a137889bfe81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "cinder-quobyte-4ab4fd3d-38dd-42d6-8381-a137889bfe81" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-4ab4fd3d-38dd-42d6-8381-a137889bfe81" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Deleting offline snapshot 4ab4fd3d-38dd-42d6-8381-a137889bfe81 of volume 2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] snapshot_file for this snap is: volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Creating offline snapshot 854ea311-4ab4-4b5f-ba61-a76320a883e2 of volume 1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f78713-2929-4941-82c0-021591da1774]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06382a2-ce68-41c3-8bfe-d2f5ca634192]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:58 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 Jul 09 09:25:58 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:58 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:25:58 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-781bf79a-47cd-488f-8ff1-7417f1f8e182 req-42747740-9a7f-44da-9022-5a144fb2599a tempest-AttachVolumeNegativeTest-689033810 None] Terminate volume connection completed successfully. Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-781bf79a-47cd-488f-8ff1-7417f1f8e182 req-42747740-9a7f-44da-9022-5a144fb2599a tempest-AttachVolumeNegativeTest-689033810 None] Deleting attachment d9a0beb7-3f23-41f8-bd61-38e64acb5e62. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:25:59 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81" returned: 0 in 0.853s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:25:59 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 0.867s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[58273932-2a6a-45af-886c-b3b4c6f32f01]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:25:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:25:59 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 1G Jul 09 09:25:59 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:25:59 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e Jul 09 09:25:59 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:00 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 1G" returned: 0 in 0.910s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:00 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:00 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:00 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e" returned: 0 in 0.946s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:00 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 Jul 09 09:26:00 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:01 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.863s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:01 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 is being set with open permissions: ugo+rw Jul 09 09:26:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:01 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:01 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:01 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:01 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81 Jul 09 09:26:01 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:02 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:02 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e.4ab4fd3d-38dd-42d6-8381-a137889bfe81" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:02 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info Jul 09 09:26:02 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-4ab4fd3d-38dd-42d6-8381-a137889bfe81" released by "_delete_snapshot" :: held 3.595s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" released by "delete_snapshot" :: held 3.622s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Created reservations ['8fdba292-816b-4d81-9060-c6cc90381f23', '9d37273b-6b14-4253-8763-b9a6f3e7a03c', 'd88c4d32-15bc-42a8-9c42-c3bbf21a72e7', '3ab2c510-ee4b-45e1-9338-62776000c4a3'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Delete snapshot completed successfully. Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6b31bd2d-44a0-4672-bc89-aef61f7ddd51 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-4ab4fd3d-38dd-42d6-8381-a137889bfe81-delete_snapshot" released by "delete_snapshot" :: held 3.802s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "cinder-2d2a1a93-01d7-4ba7-b19e-d009516d452e-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-2d2a1a93-01d7-4ba7-b19e-d009516d452e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:03 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info" returned: 0 in 0.959s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:03 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info is being set with open permissions: ugo+rw Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:03 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info Jul 09 09:26:03 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6aa8c5-678c-44ea-a4fb-209e4edfc543]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:03 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e Jul 09 09:26:03 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:04 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.info" returned: 0 in 1.101s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.595s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bdcfa7b8-c02f-454a-adc3-eb69b109d792 tempest-VolumesSnapshotTestJSON-937547723 None] Create snapshot completed successfully Jul 09 09:26:04 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e" returned: 0 in 1.129s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:04 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e Jul 09 09:26:04 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:05 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2d2a1a93-01d7-4ba7-b19e-d009516d452e" returned: 0 in 0.824s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-quobyte-2d2a1a93-01d7-4ba7-b19e-d009516d452e" released by "delete_volume" :: held 2.033s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Created reservations ['43ea3546-a514-43cc-b0d9-c88e8e6fde35', 'ecfc85ad-5707-4fcc-a2a9-f416716bee44', '804feaa4-1d7c-4a8f-b0f8-e1469372d698', 'f7cf626c-ec43-43ca-b28d-5ecee04e7f84'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:05 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:05 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (d913f304-0659-4dba-8492-81c63a4a89c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae44cc96-ac60-4077-9903-a2634d0404b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae44cc96-ac60-4077-9903-a2634d0404b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1403691682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b4ae88-16ae-4ec3-9596-c1682893894f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b90aa6c8ed2041a08197f03e536dee26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=854ea311-4ab4-4b5f-ba61-a76320a883e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:06Z,use_quota=True,user_id='8e523ee578564902885723d5ff26fe4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fc48ef-4ba1-4bb5-80ed-093d0bf735a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fc48ef-4ba1-4bb5-80ed-093d0bf735a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e8cf46-7378-4940-b294-9972322399bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e8cf46-7378-4940-b294-9972322399bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00b4ae88-16ae-4ec3-9596-c1682893894f', 'volume_name': 'volume-00b4ae88-16ae-4ec3-9596-c1682893894f', 'volume_size': 1, 'snapshot_id': '854ea311-4ab4-4b5f-ba61-a76320a883e2'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8710adf-f081-47d1-becb-ad07d1952027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8710adf-f081-47d1-becb-ad07d1952027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82af48db-40da-4cda-a344-c64ac7596eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:05 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Volume 00b4ae88-16ae-4ec3-9596-c1682893894f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00b4ae88-16ae-4ec3-9596-c1682893894f', 'volume_size': 1, 'snapshot_id': '854ea311-4ab4-4b5f-ba61-a76320a883e2'} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2-00b4ae88-16ae-4ec3-9596-c1682893894f" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2-00b4ae88-16ae-4ec3-9596-c1682893894f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Creating volume 00b4ae88-16ae-4ec3-9596-c1682893894f from snapshot 854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] snapshot: 854ea311-4ab4-4b5f-ba61-a76320a883e2, volume: 00b4ae88-16ae-4ec3-9596-c1682893894f, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d936fd5-d8ba-4d18-a41c-a7ae26cbfbf0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:06 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:06 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:06 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.830s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Deleted volume successfully. Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-07767005-4f83-424a-8076-6e4c566eefe8 tempest-SnapshotMetadataTestJSON-67026950 None] Lock "cinder-2d2a1a93-01d7-4ba7-b19e-d009516d452e-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:06 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.967s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cca349-d5e3-479d-8d1c-b6e903ae7f36]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:07 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:26:07 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:08 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 1.079s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:08 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:26:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:08 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f Jul 09 09:26:08 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (4a48660e-73b5-4182-a559-a556d3b35529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e405bbd-a40a-453b-ba63-b6d909ea7f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e405bbd-a40a-453b-ba63-b6d909ea7f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1196249822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787d540e-c198-4b69-ac91-935fa817a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c47ee9307ca4c8390ecf97f613d02eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:12Z,use_quota=True,user_id='dc40877db9364707aaf7ae4732544aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d34ba-6bf7-4a70-bb39-711ebbd81fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d34ba-6bf7-4a70-bb39-711ebbd81fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d3a888-86e8-43a0-9921-1c8596c10928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d3a888-86e8-43a0-9921-1c8596c10928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787d540e-c198-4b69-ac91-935fa817a428', 'volume_name': 'volume-787d540e-c198-4b69-ac91-935fa817a428', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15eba7a0-9c3c-4a39-9d14-9cc0fed98761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15eba7a0-9c3c-4a39-9d14-9cc0fed98761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aab0ad-0167-4fb4-bfbc-8dbbba05f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:11 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Volume 787d540e-c198-4b69-ac91-935fa817a428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787d540e-c198-4b69-ac91-935fa817a428', 'volume_size': 1} Jul 09 09:26:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f" returned: 0 in 7.668s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d042ce17-424a-426d-992b-4398fdcf3c43]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:15 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:26:15 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:16 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 1.048s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:16 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:26:16 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Converted 1024.00 MB image at 133.52 MB/s Jul 09 09:26:16 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f is being set with open permissions: ugo+rw Jul 09 09:26:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:16 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f Jul 09 09:26:16 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:17 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f" returned: 0 in 0.757s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" released by "_copy_volume_from_snapshot" :: held 11.650s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2-00b4ae88-16ae-4ec3-9596-c1682893894f" released by "_create_volume_from_snapshot" :: held 11.705s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.728s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.697s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1196249822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787d540e-c198-4b69-ac91-935fa817a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c47ee9307ca4c8390ecf97f613d02eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:12Z,use_quota=True,user_id='dc40877db9364707aaf7ae4732544aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Creating volume 787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:26:17 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:17 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 1073741824 Jul 09 09:26:17 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82af48db-40da-4cda-a344-c64ac7596eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b4ae88-16ae-4ec3-9596-c1682893894f', 'volume_size': 1, 'snapshot_id': '854ea311-4ab4-4b5f-ba61-a76320a883e2'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc626e76-fe15-40fa-ac62-05eaa16ac931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:17 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Volume volume-00b4ae88-16ae-4ec3-9596-c1682893894f (00b4ae88-16ae-4ec3-9596-c1682893894f): created successfully Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc626e76-fe15-40fa-ac62-05eaa16ac931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Flow 'volume_create_manager' (d913f304-0659-4dba-8492-81c63a4a89c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fc784bed-0e8b-47c7-95b7-f452cd9428f2 tempest-VolumesSnapshotTestJSON-937547723 None] Created volume successfully. Jul 09 09:26:18 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 1073741824" returned: 0 in 0.902s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:18 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 Jul 09 09:26:18 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-00b4ae88-16ae-4ec3-9596-c1682893894f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-00b4ae88-16ae-4ec3-9596-c1682893894f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b129a4-1151-4c30-86bc-5064779240ee]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:18 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f Jul 09 09:26:18 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:19 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aab0ad-0167-4fb4-bfbc-8dbbba05f28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787d540e-c198-4b69-ac91-935fa817a428', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa2d9f8-2ced-4485-8b91-16cc63c19fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:19 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Volume volume-787d540e-c198-4b69-ac91-935fa817a428 (787d540e-c198-4b69-ac91-935fa817a428): created successfully Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa2d9f8-2ced-4485-8b91-16cc63c19fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (4a48660e-73b5-4182-a559-a556d3b35529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-df298610-2f1b-4c27-8aa2-9a2a27ac9cfe tempest-VolumesDeleteCascade-1304509359 None] Created volume successfully. Jul 09 09:26:19 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f" returned: 0 in 0.785s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:19 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f Jul 09 09:26:19 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Creating offline snapshot c8aad0fc-aa11-4f71-9811-87503c2f9ac0 of volume 787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[372c3d85-0e44-4ab5-8372-6e5daaf6b26d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:20 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 Jul 09 09:26:20 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:20 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-00b4ae88-16ae-4ec3-9596-c1682893894f" returned: 0 in 0.694s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-00b4ae88-16ae-4ec3-9596-c1682893894f" released by "delete_volume" :: held 1.529s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['1feca46d-c0e0-4a12-9f74-a603b276a2c0', 'e59ab436-0768-46b7-93aa-9c02cfa4e539', '6a997b89-2a81-4c8d-a831-92ca3ddf36ad', '2d13b32c-305d-424d-8230-5e58795aaadb'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:20 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:20 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:20 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428" returned: 0 in 0.767s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:20 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 1G Jul 09 09:26:20 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-854ea311-4ab4-4b5f-ba61-a76320a883e2-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-854ea311-4ab4-4b5f-ba61-a76320a883e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Deleting offline snapshot 854ea311-4ab4-4b5f-ba61-a76320a883e2 of volume 1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:26:21 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] snapshot_file for this snap is: volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.683s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a6f6a2-5bce-4f2d-b0fc-126bb7f45615]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Deleted volume successfully. Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fee74929-82c9-44b0-9305-5b3bad15ed89 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-00b4ae88-16ae-4ec3-9596-c1682893894f-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:21 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:21 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:21 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 1G" returned: 0 in 0.838s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:21 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:21 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:21 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.841s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105640b-abb5-493c-9ab1-54bad72ac78d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:22 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:26:22 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:22 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 0.700s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:22 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 is being set with open permissions: ugo+rw Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:22 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:22 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:22 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:22 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:22 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:22 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 0.685s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:22 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info Jul 09 09:26:22 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:23 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.845s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:23 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2 Jul 09 09:26:23 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:24 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info" returned: 0 in 1.059s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:24 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info is being set with open permissions: ugo+rw Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:24 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info Jul 09 09:26:24 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:24 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16.854ea311-4ab4-4b5f-ba61-a76320a883e2" returned: 0 in 0.936s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-854ea311-4ab4-4b5f-ba61-a76320a883e2" released by "_delete_snapshot" :: held 3.520s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" released by "delete_snapshot" :: held 3.551s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['c6891834-08d2-43bc-b157-f9059d1054e3', '2ea54141-fb3b-4910-9f9e-5c19bd85cbd6', '8b264a31-2d83-4d26-937f-2579b68882ab', 'b44119e7-19e6-4491-9e12-af2fd4c19e39'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Delete snapshot completed successfully. Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5807428b-4604-4630-96a8-a8dab39cb1e6 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-854ea311-4ab4-4b5f-ba61-a76320a883e2-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:24 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.info" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.004s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e6d1b8cc-0c8b-41c9-992c-f35ea2925a7d tempest-VolumesDeleteCascade-1304509359 None] Create snapshot completed successfully Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-1ceb04f7-7333-4d97-ba98-8b0eac6aec16-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-1ceb04f7-7333-4d97-ba98-8b0eac6aec16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b5f50b-ca2f-4444-a394-b42bacb43218]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Creating offline snapshot 76aa7475-cad4-4729-8bff-d56e36b8dc8d of volume 787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f799053-0a2a-4a0b-9ac3-0cf87376fc0f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:25 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:26:25 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:25 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:25 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:26 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 1.013s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:26 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16 Jul 09 09:26:26 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:26 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 0.946s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787d540e-c198-4b69-ac91-935fa817a428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:26 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d 1G Jul 09 09:26:26 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:27 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" returned: 0 in 0.671s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-1ceb04f7-7333-4d97-ba98-8b0eac6aec16" released by "delete_volume" :: held 1.779s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['d65237fc-f268-4393-9cfe-9ae95e5ce1dc', 'af66978f-369c-46b6-bda9-14d783076cd3', '0246b343-34f7-4de5-9400-f101838bcc87', '51545e2b-d4ee-40c6-b62f-12fa621d4e50'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:27 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:27 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:27 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d 1G" returned: 0 in 0.864s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:27 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d Jul 09 09:26:27 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-92ed2340-108b-4a32-9da5-fa536cff4ff1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-92ed2340-108b-4a32-9da5-fa536cff4ff1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30a169-4a3c-46af-9844-d050e52b44fb]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:28 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 Jul 09 09:26:28 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:28 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.837s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:28 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Deleted volume successfully. Jul 09 09:26:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7a8b07b3-1651-4601-a491-0978c857594a tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-1ceb04f7-7333-4d97-ba98-8b0eac6aec16-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:28 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d" returned: 0 in 0.921s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:28 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d is being set with open permissions: ugo+rw Jul 09 09:26:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:28 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d Jul 09 09:26:28 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:29 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1" returned: 0 in 1.194s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:29 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1 Jul 09 09:26:29 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:29 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d" returned: 0 in 1.111s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.061s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3e7e9d67-bad9-4ae3-af77-018daf1ce918 tempest-VolumesDeleteCascade-1304509359 None] Create snapshot completed successfully Jul 09 09:26:30 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-92ed2340-108b-4a32-9da5-fa536cff4ff1" returned: 0 in 0.997s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-quobyte-92ed2340-108b-4a32-9da5-fa536cff4ff1" released by "delete_volume" :: held 2.294s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Created reservations ['6f0b7ac3-ae2d-45e2-b22f-8c37d22d4c09', '3152860f-c9eb-4f33-915a-264de5349ab7', 'b0fd8317-8fc6-462d-ab2d-af310e2d64b3', '0f4fb93a-c856-46e4-9efe-355498c6c79b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:30 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:30 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-787d540e-c198-4b69-ac91-935fa817a428-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-787d540e-c198-4b69-ac91-935fa817a428-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Performing cascade delete. {{(pid=87265) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-76aa7475-cad4-4729-8bff-d56e36b8dc8d-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-76aa7475-cad4-4729-8bff-d56e36b8dc8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-76aa7475-cad4-4729-8bff-d56e36b8dc8d" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-76aa7475-cad4-4729-8bff-d56e36b8dc8d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Deleting offline snapshot 76aa7475-cad4-4729-8bff-d56e36b8dc8d of volume 787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] snapshot_file for this snap is: volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d9476d-210f-4573-aeec-0b50d4590d0d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:31 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.041s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Deleted volume successfully. Jul 09 09:26:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f5b5f709-ac6e-45ea-add1-8a8144454716 tempest-VolumesSnapshotTestJSON-937547723 None] Lock "cinder-92ed2340-108b-4a32-9da5-fa536cff4ff1-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:31 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d Jul 09 09:26:31 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:32 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d" returned: 0 in 1.335s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787d540e-c198-4b69-ac91-935fa817a428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:32 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90944f0-c138-4d51-9b4d-48733622705a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:32 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:32 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:33 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 1.063s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787d540e-c198-4b69-ac91-935fa817a428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:33 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d Jul 09 09:26:33 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-4f9b81dd-4e61-43dd-8767-7c2f99d840d3 req-ab7e1299-7c57-4030-8a3f-0b204ccf0a90 tempest-TestMinimumBasicScenario-1342121504 None] Terminate volume connection completed successfully. Jul 09 09:26:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-4f9b81dd-4e61-43dd-8767-7c2f99d840d3 req-ab7e1299-7c57-4030-8a3f-0b204ccf0a90 tempest-TestMinimumBasicScenario-1342121504 None] Deleting attachment ef24516b-34ed-4cc5-9962-1af54fa7a30d. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:26:34 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d" returned: 0 in 1.119s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:34 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d Jul 09 09:26:34 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:35 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.76aa7475-cad4-4729-8bff-d56e36b8dc8d" returned: 0 in 1.070s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-76aa7475-cad4-4729-8bff-d56e36b8dc8d" released by "_delete_snapshot" :: held 4.789s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" released by "delete_snapshot" :: held 4.841s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=98,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=93,cinder:SELECT=97,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['cced6758-6ec3-4ec5-bdcb-007390d6b736', '6b9401ae-6878-46c2-a2ed-d4295ab26744', 'c781e0f2-33ea-4900-86ce-7f4ee28c1e48', '941e975e-09f0-49e5-baa7-3e922a8bff13'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "cinder-2f473804-be1c-405e-b216-2486d7bf80cd-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "cinder-2f473804-be1c-405e-b216-2486d7bf80cd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "cinder-quobyte-2f473804-be1c-405e-b216-2486d7bf80cd" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Delete snapshot completed successfully. Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "cinder-quobyte-2f473804-be1c-405e-b216-2486d7bf80cd" acquired by "delete_volume" :: waited 0.053s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-76aa7475-cad4-4729-8bff-d56e36b8dc8d-delete_snapshot" released by "delete_snapshot" :: held 5.193s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-c8aad0fc-aa11-4f71-9811-87503c2f9ac0-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[764cfdf7-7e49-4335-b33b-5706d736158a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-c8aad0fc-aa11-4f71-9811-87503c2f9ac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-c8aad0fc-aa11-4f71-9811-87503c2f9ac0" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-c8aad0fc-aa11-4f71-9811-87503c2f9ac0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Deleting offline snapshot c8aad0fc-aa11-4f71-9811-87503c2f9ac0 of volume 787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] snapshot_file for this snap is: volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[69638a0d-82c9-4202-90a9-02202d8a9118]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:36 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd Jul 09 09:26:36 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:36 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:36 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:37 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd" returned: 0 in 1.367s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:37 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 1.252s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787d540e-c198-4b69-ac91-935fa817a428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:37 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd Jul 09 09:26:37 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ff3b7-a4ec-4645-96b7-d690cd74db9e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:37 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 Jul 09 09:26:37 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:38 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2f473804-be1c-405e-b216-2486d7bf80cd" returned: 0 in 0.908s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "cinder-quobyte-2f473804-be1c-405e-b216-2486d7bf80cd" released by "delete_volume" :: held 2.337s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Created reservations ['e5fd2df5-83fb-4c9d-bed5-23393e3686dc', 'f0ce8704-8755-4991-baad-217b32d1a2ad', 'c8c145c3-a270-4eb5-8796-6caf409b8f54', '632b243b-74e0-458d-8f30-b7cf60948bd0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:38 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:38 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:38 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428" returned: 0 in 1.105s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:38 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:38 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:39 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.988s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Deleted volume successfully. Jul 09 09:26:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-dfa6377c-a690-4b14-bbf2-8087b208f553 tempest-TestMinimumBasicScenario-1342121504 None] Lock "cinder-2f473804-be1c-405e-b216-2486d7bf80cd-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:39 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 1.155s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:40 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0 Jul 09 09:26:40 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:40 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428.c8aad0fc-aa11-4f71-9811-87503c2f9ac0" returned: 0 in 0.894s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-c8aad0fc-aa11-4f71-9811-87503c2f9ac0" released by "_delete_snapshot" :: held 4.538s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" released by "delete_snapshot" :: held 4.572s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['171fa6c7-92c5-4dac-9202-c73312df97f0', '71ad23d5-dc71-4e5f-a5dc-e0c8f50bc1a5', '6505758c-20fb-4e24-9613-2d19652499f4', '3eddf32f-d1a0-41d1-ac18-930807e3ea55'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Delete snapshot completed successfully. Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-c8aad0fc-aa11-4f71-9811-87503c2f9ac0-delete_snapshot" released by "delete_snapshot" :: held 4.838s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Snapshots deleted, issuing volume delete {{(pid=87265) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac4343-463a-4d3c-9d8d-109871dcd00f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:41 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 Jul 09 09:26:41 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:42 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428" returned: 0 in 1.192s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:42 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428 Jul 09 09:26:42 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:43 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-787d540e-c198-4b69-ac91-935fa817a428" returned: 0 in 0.868s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-787d540e-c198-4b69-ac91-935fa817a428" released by "delete_volume" :: held 2.135s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['a58e74cc-bbfd-487e-aa70-280dbf4f19d0', '39a402ae-ec6e-498f-8d23-52009c479f60', 'bb6a5d41-ae38-40b7-9a4b-e8525c74400b', '5dbb33d7-f84b-4c07-bd4b-f852fce44462'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:43 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:43 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:44 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.087s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (25539882-4224-446f-8e9e-96e5a210dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdc2b09-3c9b-4b39-af7c-589d72347ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Deleted volume successfully. Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdc2b09-3c9b-4b39-af7c-589d72347ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1740118039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeab006-6145-404f-a1de-14f0b870b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c47ee9307ca4c8390ecf97f613d02eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:45Z,use_quota=True,user_id='dc40877db9364707aaf7ae4732544aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b46d45-daf5-4f5e-8a68-77781cbe36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b46d45-daf5-4f5e-8a68-77781cbe36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a47107-b01b-485e-8d66-2e31fc8e6768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a47107-b01b-485e-8d66-2e31fc8e6768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feeab006-6145-404f-a1de-14f0b870b40d', 'volume_name': 'volume-feeab006-6145-404f-a1de-14f0b870b40d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f7205-69e2-46d0-8d64-872cf80877a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f7205-69e2-46d0-8d64-872cf80877a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd8631a-c0b4-4e20-835f-93a28392543e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:44 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Volume feeab006-6145-404f-a1de-14f0b870b40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feeab006-6145-404f-a1de-14f0b870b40d', 'volume_size': 1} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1740118039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feeab006-6145-404f-a1de-14f0b870b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c47ee9307ca4c8390ecf97f613d02eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:45Z,use_quota=True,user_id='dc40877db9364707aaf7ae4732544aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Creating volume feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:26:44 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fa4f591d-7796-4ba6-9550-2ad5ae32e2d4 tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-787d540e-c198-4b69-ac91-935fa817a428-delete_volume" released by "delete_volume" :: held 13.815s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:26:44 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d 1073741824 Jul 09 09:26:44 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:45 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d 1073741824" returned: 0 in 0.886s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:45 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:26:45 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:46 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd8631a-c0b4-4e20-835f-93a28392543e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feeab006-6145-404f-a1de-14f0b870b40d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662b9b7c-67ff-4a79-b1c2-835883fefda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Volume volume-feeab006-6145-404f-a1de-14f0b870b40d (feeab006-6145-404f-a1de-14f0b870b40d): created successfully Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662b9b7c-67ff-4a79-b1c2-835883fefda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (25539882-4224-446f-8e9e-96e5a210dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ce758cfe-4ffb-41aa-b7ba-73207f5d8dfe tempest-VolumesDeleteCascade-1304509359 None] Created volume successfully. Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Creating offline snapshot e4329891-85e7-4893-8328-bf70ca715f21 of volume feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2871637-9028-43df-b448-817547b9b196]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:47 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:26:47 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:47 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 1.024s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:48 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 1G Jul 09 09:26:48 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:48 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 1G" returned: 0 in 0.989s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feeab006-6145-404f-a1de-14f0b870b40d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:49 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feeab006-6145-404f-a1de-14f0b870b40d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:26:49 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:49 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feeab006-6145-404f-a1de-14f0b870b40d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 0.874s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:49 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 is being set with open permissions: ugo+rw Jul 09 09:26:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:49 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:26:49 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:50 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:26:50 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:50 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 0.745s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:50 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info Jul 09 09:26:50 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:51 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.037s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:26:51 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info" returned: 0 in 0.950s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:51 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info is being set with open permissions: ugo+rw Jul 09 09:26:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:51 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info Jul 09 09:26:51 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:52 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.info" returned: 0 in 0.839s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.540s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1f56b493-d8d2-4797-9c3c-a908cb6bcf3a tempest-VolumesDeleteCascade-1304509359 None] Create snapshot completed successfully Jul 09 09:26:53 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:26:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (53eb8ea5-c327-42ed-8f2a-c65f229c97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7f6892-5ed4-4a16-83cc-175baeef8b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7f6892-5ed4-4a16-83cc-175baeef8b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-868705550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f2c90b-8938-42a1-84ba-b6833e528995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c47ee9307ca4c8390ecf97f613d02eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4329891-85e7-4893-8328-bf70ca715f21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:54Z,use_quota=True,user_id='dc40877db9364707aaf7ae4732544aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b954a33d-dc78-4e47-8ddf-f69abf83cc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b954a33d-dc78-4e47-8ddf-f69abf83cc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df00658b-7cb3-4ae2-b809-bfc128b1ce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df00658b-7cb3-4ae2-b809-bfc128b1ce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68f2c90b-8938-42a1-84ba-b6833e528995', 'volume_name': 'volume-68f2c90b-8938-42a1-84ba-b6833e528995', 'volume_size': 1, 'snapshot_id': 'e4329891-85e7-4893-8328-bf70ca715f21'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50102913-556a-470d-915e-d609f0222bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50102913-556a-470d-915e-d609f0222bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cfb277-acc4-4931-96b4-9bd4c4d126a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Volume 68f2c90b-8938-42a1-84ba-b6833e528995: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68f2c90b-8938-42a1-84ba-b6833e528995', 'volume_size': 1, 'snapshot_id': 'e4329891-85e7-4893-8328-bf70ca715f21'} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21-68f2c90b-8938-42a1-84ba-b6833e528995" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21-68f2c90b-8938-42a1-84ba-b6833e528995" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Creating volume 68f2c90b-8938-42a1-84ba-b6833e528995 from snapshot e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] snapshot: e4329891-85e7-4893-8328-bf70ca715f21, volume: 68f2c90b-8938-42a1-84ba-b6833e528995, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30e39d0-4207-48a3-a4a2-9bef39c425d7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:54 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:26:54 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:55 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 0.948s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feeab006-6145-404f-a1de-14f0b870b40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb39159-0f48-4ae3-97f2-5604e13512f9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:55 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:26:55 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (540e8d75-3726-4d00-8c5f-b8ec604e4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5672ca-6e5c-4771-9a29-e685a5f9fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5672ca-6e5c-4771-9a29-e685a5f9fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-512707909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d756e-1f77-4ae6-8da7-4823f4ae473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:56Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc54cfa8-1c50-4aac-a243-d08b91969070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc54cfa8-1c50-4aac-a243-d08b91969070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7d8200-8850-46ca-b26c-056efcce084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7d8200-8850-46ca-b26c-056efcce084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106d756e-1f77-4ae6-8da7-4823f4ae473f', 'volume_name': 'volume-106d756e-1f77-4ae6-8da7-4823f4ae473f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eb95a3-00f0-4055-8580-786af8f1115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6eb95a3-00f0-4055-8580-786af8f1115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a829fc1-6c8e-4fcf-a1af-1f4dd7f7b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:26:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Volume 106d756e-1f77-4ae6-8da7-4823f4ae473f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106d756e-1f77-4ae6-8da7-4823f4ae473f', 'volume_size': 1} Jul 09 09:26:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:26:56 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 09 09:26:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 1.132s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:26:56 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:26:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:26:56 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 Jul 09 09:26:56 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:02 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995" returned: 0 in 6.409s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920a8b6-5da6-4596-9638-a5b5bdd35e1a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:02 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:27:02 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:03 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 1.099s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:03 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:27:03 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Converted 1024.00 MB image at 159.72 MB/s Jul 09 09:27:03 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 is being set with open permissions: ugo+rw Jul 09 09:27:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:03 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 Jul 09 09:27:03 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:04 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" released by "_copy_volume_from_snapshot" :: held 10.539s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21-68f2c90b-8938-42a1-84ba-b6833e528995" released by "_create_volume_from_snapshot" :: held 10.586s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.609s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.910s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-512707909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d756e-1f77-4ae6-8da7-4823f4ae473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9835ab9d5364266a4a9ac84dae42e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:26:56Z,use_quota=True,user_id='8f736e1bad044dd7a50deebac86f2327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Creating volume 106d756e-1f77-4ae6-8da7-4823f4ae473f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:04 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:04 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f 1073741824 Jul 09 09:27:04 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cfb277-acc4-4931-96b4-9bd4c4d126a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f2c90b-8938-42a1-84ba-b6833e528995', 'volume_size': 1, 'snapshot_id': 'e4329891-85e7-4893-8328-bf70ca715f21'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774d315c-ee5b-4f24-a320-72be1927b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:04 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Volume volume-68f2c90b-8938-42a1-84ba-b6833e528995 (68f2c90b-8938-42a1-84ba-b6833e528995): created successfully Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774d315c-ee5b-4f24-a320-72be1927b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Flow 'volume_create_manager' (53eb8ea5-c327-42ed-8f2a-c65f229c97af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9354f900-7899-4441-8032-bd5adee081cb tempest-VolumesDeleteCascade-1304509359 None] Created volume successfully. Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-feeab006-6145-404f-a1de-14f0b870b40d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-feeab006-6145-404f-a1de-14f0b870b40d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Performing cascade delete. {{(pid=87265) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-e4329891-85e7-4893-8328-bf70ca715f21-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-e4329891-85e7-4893-8328-bf70ca715f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Deleting offline snapshot e4329891-85e7-4893-8328-bf70ca715f21 of volume feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] snapshot_file for this snap is: volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cb061c-54d5-4cb1-a102-c59508d30a02]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:05 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:27:05 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:05 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f 1073741824" returned: 0 in 1.292s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:06 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f Jul 09 09:27:06 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:06 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 1.247s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feeab006-6145-404f-a1de-14f0b870b40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1e83c1-ecce-4854-93b2-d722d89f19fc]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:06 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f" returned: 0 in 0.949s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a829fc1-6c8e-4fcf-a1af-1f4dd7f7b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106d756e-1f77-4ae6-8da7-4823f4ae473f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:07 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:27:07 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230f6fb6-73f3-4b84-bb8f-1f55c9716558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:07 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Volume volume-106d756e-1f77-4ae6-8da7-4823f4ae473f (106d756e-1f77-4ae6-8da7-4823f4ae473f): created successfully Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230f6fb6-73f3-4b84-bb8f-1f55c9716558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Flow 'volume_create_manager' (540e8d75-3726-4d00-8c5f-b8ec604e4877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d262cde7-c013-4829-af4e-bbf498b3b72b tempest-AttachVolumeNegativeTest-689033810 None] Created volume successfully. Jul 09 09:27:07 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 0.872s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:07 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:27:07 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:08 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 0.920s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:08 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21 Jul 09 09:27:08 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:09 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d.e4329891-85e7-4893-8328-bf70ca715f21" returned: 0 in 0.709s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-e4329891-85e7-4893-8328-bf70ca715f21" released by "_delete_snapshot" :: held 3.884s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" released by "delete_snapshot" :: held 3.915s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['70d71818-2cfc-49ec-83c5-df8bca89a138', '025673eb-b74f-40e8-813a-48203c8a4d76', 'faac42f8-0ca0-4acf-abe0-dbc1058ad688', '8956c523-e881-4acf-8d7e-676af666560d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Delete snapshot completed successfully. Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-e4329891-85e7-4893-8328-bf70ca715f21-delete_snapshot" released by "delete_snapshot" :: held 4.103s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Snapshots deleted, issuing volume delete {{(pid=87265) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84c14b-8cb5-4b9d-98a5-58af26db4aba]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:09 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:27:09 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:10 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 1.064s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:10 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d Jul 09 09:27:10 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (c1b73ced-90f3-4a41-9e5c-df0f14e68972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6c6a37-4e40-40fd-a06c-8ce25f295d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6c6a37-4e40-40fd-a06c-8ce25f295d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-501105853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b19e703-8f30-434a-bab4-2d709c752ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:11Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8684fa71-2fe8-4e05-a465-1295e891ba37),volume_type_id=8684fa71-2fe8-4e05-a465-1295e891ba37)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6414a9a7-2021-48ac-bf40-1e2161bdf32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6414a9a7-2021-48ac-bf40-1e2161bdf32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aaeb49-ca11-4545-bddc-1180559a27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aaeb49-ca11-4545-bddc-1180559a27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b19e703-8f30-434a-bab4-2d709c752ac3', 'volume_name': 'volume-6b19e703-8f30-434a-bab4-2d709c752ac3', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98b9a8-2f19-48b9-9b15-2e2145371971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98b9a8-2f19-48b9-9b15-2e2145371971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fb2e24-6655-4425-a230-6dfc8c848bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:11 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume 6b19e703-8f30-434a-bab4-2d709c752ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b19e703-8f30-434a-bab4-2d709c752ac3', 'volume_size': 1} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-501105853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b19e703-8f30-434a-bab4-2d709c752ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:11Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8684fa71-2fe8-4e05-a465-1295e891ba37),volume_type_id=8684fa71-2fe8-4e05-a465-1295e891ba37)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Creating volume 6b19e703-8f30-434a-bab4-2d709c752ac3 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:11 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:11 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 1073741824 Jul 09 09:27:11 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:11 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feeab006-6145-404f-a1de-14f0b870b40d" returned: 0 in 1.270s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-feeab006-6145-404f-a1de-14f0b870b40d" released by "delete_volume" :: held 2.417s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (50d53b1d-8e48-4243-a4a2-9025492e5bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a856eb41-469f-400c-853e-884852330543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a856eb41-469f-400c-853e-884852330543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-612135045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38532dfb-54c9-4343-a1af-219acb1b07e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:12Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20cfd027-e1cb-4718-ba7f-97cc8c45cde4),volume_type_id=20cfd027-e1cb-4718-ba7f-97cc8c45cde4)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5738e082-a6c1-49be-ad20-d5a3ee2f40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5738e082-a6c1-49be-ad20-d5a3ee2f40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c0f98b-bc14-4835-89b3-518560f53cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c0f98b-bc14-4835-89b3-518560f53cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38532dfb-54c9-4343-a1af-219acb1b07e6', 'volume_name': 'volume-38532dfb-54c9-4343-a1af-219acb1b07e6', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeba6ff-eeeb-41c2-b893-d8dbd0387d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeba6ff-eeeb-41c2-b893-d8dbd0387d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc21e9f-8ff2-4862-9664-a7d1139847bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume 38532dfb-54c9-4343-a1af-219acb1b07e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38532dfb-54c9-4343-a1af-219acb1b07e6', 'volume_size': 1} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['a18780df-fe3b-44ec-b767-a4883c6014db', '1a2ad3a9-acaa-45fc-bd5f-f41fb18167b0', 'b8c0a817-a6f4-4a7d-a1ef-50d34c1e77f8', 'b2aa17e1-77b1-449a-9ed2-f0ae2cbbeecd'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:12 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:12 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:13 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (ae751fd1-3a2b-4e65-a72e-6834387e1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdd3d03-7f58-406c-be33-25b9f549fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 1073741824" returned: 0 in 1.272s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdd3d03-7f58-406c-be33-25b9f549fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-323344950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06584ea0-a5f7-4054-8d59-31b0508924ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:13Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea72fd7f-ae8d-4377-8e72-c5c63441f3a4),volume_type_id=ea72fd7f-ae8d-4377-8e72-c5c63441f3a4)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdcf10a-4adb-49e4-bf03-c2d547f550a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdcf10a-4adb-49e4-bf03-c2d547f550a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fececc3-6b99-49c7-926e-0d5f878b876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:27:13 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.897s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Deleted volume successfully. Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-68f2c90b-8938-42a1-84ba-b6833e528995-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:13 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 Jul 09 09:27:13 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3823d2cd-f73a-4875-aac3-b412da232bbf tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-feeab006-6145-404f-a1de-14f0b870b40d-delete_volume" released by "delete_volume" :: held 7.915s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-68f2c90b-8938-42a1-84ba-b6833e528995-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e42bb5-c10e-408b-a941-5d86e4a7561a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:13 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 Jul 09 09:27:13 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fececc3-6b99-49c7-926e-0d5f878b876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06584ea0-a5f7-4054-8d59-31b0508924ee', 'volume_name': 'volume-06584ea0-a5f7-4054-8d59-31b0508924ee', 'volume_size': 1, 'image_id': '17164b93-88f8-4312-b50e-40fee296464d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1975643773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54709de35fd14fb18689ffd3414c223f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17164b93-88f8-4312-b50e-40fee296464d', 'created_at': datetime.datetime(2026, 7, 9, 7, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 27, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17164b93-88f8-4312-b50e-40fee296464d/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f70744-1450-44b2-aea4-a5eb857336e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f70744-1450-44b2-aea4-a5eb857336e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03e77c-2384-4989-9fc6-d21eec4a535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:13 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume 06584ea0-a5f7-4054-8d59-31b0508924ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06584ea0-a5f7-4054-8d59-31b0508924ee', 'volume_size': 1, 'image_id': '17164b93-88f8-4312-b50e-40fee296464d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1975643773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54709de35fd14fb18689ffd3414c223f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17164b93-88f8-4312-b50e-40fee296464d', 'created_at': datetime.datetime(2026, 7, 9, 7, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 27, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17164b93-88f8-4312-b50e-40fee296464d/file', 'properties': {}}, 'image_service': } Jul 09 09:27:13 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Trying to clone 06584ea0-a5f7-4054-8d59-31b0508924ee from image 17164b93-88f8-4312-b50e-40fee296464d at location (None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:27:14 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3" returned: 0 in 0.886s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.226s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fb2e24-6655-4425-a230-6dfc8c848bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b19e703-8f30-434a-bab4-2d709c752ac3', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b07ae9f-35ea-4f42-93d1-8a2f6cec2afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dadf01-edd9-47d0-928b-e5017cc772a1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume volume-6b19e703-8f30-434a-bab4-2d709c752ac3 (6b19e703-8f30-434a-bab4-2d709c752ac3): created successfully Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b07ae9f-35ea-4f42-93d1-8a2f6cec2afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (c1b73ced-90f3-4a41-9e5c-df0f14e68972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e044b578-3a7e-485b-a61b-dfe8d87b01a0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Created volume successfully. Jul 09 09:27:14 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f Jul 09 09:27:14 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:14 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995" returned: 0 in 1.080s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:14 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995 Jul 09 09:27:14 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:15 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f" returned: 0 in 1.256s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.295s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.271s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-612135045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38532dfb-54c9-4343-a1af-219acb1b07e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:12Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20cfd027-e1cb-4718-ba7f-97cc8c45cde4),volume_type_id=20cfd027-e1cb-4718-ba7f-97cc8c45cde4)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Creating volume 38532dfb-54c9-4343-a1af-219acb1b07e6 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:15 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:15 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 1073741824 Jul 09 09:27:15 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-106d756e-1f77-4ae6-8da7-4823f4ae473f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dc88314-d441-4eca-b7e9-6ea09a5788de', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:27:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-7cdcedde-8caa-4141-887d-228446aeddfa req-22fd7e9b-bcbf-4b9b-8fe9-46751b91e159 tempest-AttachVolumeNegativeTest-689033810 None] attachment_update completed successfully. Jul 09 09:27:15 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68f2c90b-8938-42a1-84ba-b6833e528995" returned: 0 in 1.160s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-quobyte-68f2c90b-8938-42a1-84ba-b6833e528995" released by "delete_volume" :: held 2.303s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Created reservations ['f6a0f379-ae96-464a-a8c7-0cfa9d0f0c09', '4a5dd426-31c4-41c5-9c75-03afa0ed6134', 'c8fb4f03-6ab8-4752-bb16-511ec5eff428', 'c13f17d6-33d2-4b3f-a94f-61bd438d598c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:15 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:15 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:16 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 1073741824" returned: 0 in 1.294s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:16 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.969s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:16 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Deleted volume successfully. Jul 09 09:27:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c480c81-2fd2-4e6d-85ad-b1dbe0a8932a tempest-VolumesDeleteCascade-1304509359 None] Lock "cinder-68f2c90b-8938-42a1-84ba-b6833e528995-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:16 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 Jul 09 09:27:16 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:17 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6" returned: 0 in 0.978s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc21e9f-8ff2-4862-9664-a7d1139847bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38532dfb-54c9-4343-a1af-219acb1b07e6', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29014cbf-696a-4473-93a0-f15827df0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:17 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume volume-38532dfb-54c9-4343-a1af-219acb1b07e6 (38532dfb-54c9-4343-a1af-219acb1b07e6): created successfully Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29014cbf-696a-4473-93a0-f15827df0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (50d53b1d-8e48-4243-a4a2-9025492e5bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:17 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7c6766aa-04ce-49a4-899f-041e0d141cb9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Created volume successfully. Jul 09 09:27:18 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD, size 20.69 MB, duration 5.19 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:27:18 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Image download 20.69 MB at 3.98 MB/s Jul 09 09:27:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd42a06-a69a-4c84-8d49-60012fe69e61]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:18 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD Jul 09 09:27:18 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:19 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:19 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Temporary image 17164b93-88f8-4312-b50e-40fee296464d is fetched for user ba84fee0ff444b9bbc83248b077b5022. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:27:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3200041-1823-48c4-b1d6-1b1b2af9efb4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:20 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD Jul 09 09:27:20 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Flow 'volume_create_manager' (e3a04128-f27b-48a1-9b5e-22839a7aeac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0a6f1b-1fd0-4d4e-a171-62fc1df77102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0a6f1b-1fd0-4d4e-a171-62fc1df77102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-618151984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d38507-70de-4f8c-9414-4d3074c51e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d25ab7712d4eb89513a55dbfec1f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:20Z,use_quota=True,user_id='ce6e8faa84ed4fa4b314379fd35ad822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebccbed3-2686-4a59-89f0-96f0170f8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebccbed3-2686-4a59-89f0-96f0170f8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2f9293-a3cd-4596-bdd0-1b733c2f3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2f9293-a3cd-4596-bdd0-1b733c2f3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d38507-70de-4f8c-9414-4d3074c51e70', 'volume_name': 'volume-27d38507-70de-4f8c-9414-4d3074c51e70', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b801e1b-688b-429a-8af4-65890f4187d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b801e1b-688b-429a-8af4-65890f4187d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f702e27a-badc-49af-a7da-3e34cde196be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Volume 27d38507-70de-4f8c-9414-4d3074c51e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d38507-70de-4f8c-9414-4d3074c51e70', 'volume_size': 1} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-618151984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d38507-70de-4f8c-9414-4d3074c51e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d25ab7712d4eb89513a55dbfec1f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:20Z,use_quota=True,user_id='ce6e8faa84ed4fa4b314379fd35ad822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Creating volume 27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:20 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:20 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 1073741824 Jul 09 09:27:20 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:20 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:21 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 1073741824" returned: 0 in 1.095s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:21 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:21 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:22 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 0.712s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-323344950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06584ea0-a5f7-4054-8d59-31b0508924ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54709de35fd14fb18689ffd3414c223f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:13Z,use_quota=True,user_id='ba84fee0ff444b9bbc83248b077b5022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea72fd7f-ae8d-4377-8e72-c5c63441f3a4),volume_type_id=ea72fd7f-ae8d-4377-8e72-c5c63441f3a4)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Creating volume 06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f702e27a-badc-49af-a7da-3e34cde196be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d38507-70de-4f8c-9414-4d3074c51e70', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe3503-37fd-4c3e-9a39-7932737d7fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:22 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1073741824 Jul 09 09:27:22 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Volume volume-27d38507-70de-4f8c-9414-4d3074c51e70 (27d38507-70de-4f8c-9414-4d3074c51e70): created successfully Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe3503-37fd-4c3e-9a39-7932737d7fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Flow 'volume_create_manager' (e3a04128-f27b-48a1-9b5e-22839a7aeac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1b94a771-d6fe-4f9a-b819-1206bdb16bc9 tempest-VolumesCloneTest-1946227083 None] Created volume successfully. Jul 09 09:27:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-e04d3293-285a-48e2-92d4-f95b94525d42 req-76edd960-8ade-40b3-97a8-cb8969d8032e tempest-AttachVolumeNegativeTest-689033810 None] Terminate volume connection completed successfully. Jul 09 09:27:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-e04d3293-285a-48e2-92d4-f95b94525d42 req-76edd960-8ade-40b3-97a8-cb8969d8032e tempest-AttachVolumeNegativeTest-689033810 None] Deleting attachment 6dc88314-d441-4eca-b7e9-6ea09a5788de. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:27:23 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1073741824" returned: 0 in 0.944s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:23 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:23 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:23 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 0.722s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:23 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Attempting download of 17164b93-88f8-4312-b50e-40fee296464d ((None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}])) to volume 06584ea0-a5f7-4054-8d59-31b0508924ee. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06378cc-36a8-4ae4-96e4-6317c94fba51]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Flow 'volume_create_manager' (153c9717-63b4-4642-aa43-6f679cd1b39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9480570f-5e3a-46ba-9334-21765c88cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9480570f-5e3a-46ba-9334-21765c88cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1560621834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242baa37-9cbe-452c-acac-03a701897dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97d25ab7712d4eb89513a55dbfec1f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=27d38507-70de-4f8c-9414-4d3074c51e70,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:24Z,use_quota=True,user_id='ce6e8faa84ed4fa4b314379fd35ad822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd11f2-2c58-4b97-b379-012ae1b41976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd11f2-2c58-4b97-b379-012ae1b41976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91921449-6c63-4efa-8154-da2576470e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91921449-6c63-4efa-8154-da2576470e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '242baa37-9cbe-452c-acac-03a701897dd9', 'volume_name': 'volume-242baa37-9cbe-452c-acac-03a701897dd9', 'volume_size': 2, 'source_volid': '27d38507-70de-4f8c-9414-4d3074c51e70', 'source_volstatus': 'available'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52919bb5-947f-4546-b310-62f99327573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52919bb5-947f-4546-b310-62f99327573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8495cf-bc3f-4a2f-9cb4-0feb7f2d1487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Volume 242baa37-9cbe-452c-acac-03a701897dd9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-242baa37-9cbe-452c-acac-03a701897dd9', 'volume_size': 2, 'source_volid': '27d38507-70de-4f8c-9414-4d3074c51e70', 'source_volstatus': 'available'} Jul 09 09:27:24 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm Jul 09 09:27:24 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Cloning volume 27d38507-70de-4f8c-9414-4d3074c51e70 to volume 242baa37-9cbe-452c-acac-03a701897dd9 Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Creating offline snapshot b2fd7a26-88c6-43e3-9d95-16db49c06cfc of volume 27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cda837-6e01-46d4-baba-1c4114f7de6c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:24 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:24 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:24 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm" returned: 0 in 0.932s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:25 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm Jul 09 09:27:25 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:25 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 1.166s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:25 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc 1G Jul 09 09:27:25 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:26 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm" returned: 1 in 1.083s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17164b93-88f8-4312-b50e-40fee296464d__iqosomm' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0d104a-cba7-43f5-adc8-b27d14721ecf]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:26 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD Jul 09 09:27:26 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:26 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc 1G" returned: 0 in 1.177s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d38507-70de-4f8c-9414-4d3074c51e70 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:26 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d38507-70de-4f8c-9414-4d3074c51e70 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:26 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:27 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD" returned: 0 in 1.344s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:27 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] 17164b93-88f8-4312-b50e-40fee296464d was qcow2, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:27:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:27 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:27 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:27 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d38507-70de-4f8c-9414-4d3074c51e70 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 1.377s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:28 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc is being set with open permissions: ugo+rw Jul 09 09:27:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:28 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:28 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:28 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:28 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info Jul 09 09:27:28 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:29 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info" returned: 0 in 0.991s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:29 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info is being set with open permissions: ugo+rw Jul 09 09:27:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:29 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info Jul 09 09:27:29 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:30 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 2.900s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17164b93-88f8-4312-b50e-40fee296464d_vf6_neundevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:27:30 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Converted 112.00 MB image at 38.60 MB/s Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:30 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1G Jul 09 09:27:30 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:30 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.info" returned: 0 in 1.074s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] snapshot: b2fd7a26-88c6-43e3-9d95-16db49c06cfc, volume: 242baa37-9cbe-452c-acac-03a701897dd9, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf7f397-77a8-4baf-b34e-b9ec9b0794e6]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:31 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:31 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:31 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee 1G" returned: 0 in 0.993s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdde841-7300-45a0-8600-56f502aedbb8]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:31 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:31 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:32 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 1.225s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27d38507-70de-4f8c-9414-4d3074c51e70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71e790-6615-4903-bcfb-80b78dc45815]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Flow 'volume_create_manager' (dfdb9898-dcd6-42f4-ae2a-156a42937210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:32 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:32 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635dd685-a982-4298-92ac-ffb036e04553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635dd685-a982-4298-92ac-ffb036e04553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-628309632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8ae354-4972-44ac-a876-6c73046073a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d821ef970d3c4621a4526d33342ee494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:32Z,use_quota=True,user_id='47b4067c75fb4d49bd03ebaa049fd146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4742c10a-56d3-48b6-b194-2dc0241aad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4742c10a-56d3-48b6-b194-2dc0241aad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f25b51-7a5b-40c9-ab81-e85ddd6585fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f25b51-7a5b-40c9-ab81-e85ddd6585fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8ae354-4972-44ac-a876-6c73046073a3', 'volume_name': 'volume-5d8ae354-4972-44ac-a876-6c73046073a3', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28343fed-1f78-488f-8b54-d5c89636f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28343fed-1f78-488f-8b54-d5c89636f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da0768c-c09d-4be0-b0f9-3f39dd543bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume 5d8ae354-4972-44ac-a876-6c73046073a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8ae354-4972-44ac-a876-6c73046073a3', 'volume_size': 1} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:32 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 1.376s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Flow 'volume_create_manager' (aa7df71a-5bb9-45b8-b82f-788a566d71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:32 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:32 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aec5e6-518b-4afe-9890-e56414684508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aec5e6-518b-4afe-9890-e56414684508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1167228012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eba9c80-c909-45bd-ac7a-1d849152c71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d821ef970d3c4621a4526d33342ee494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:33Z,use_quota=True,user_id='47b4067c75fb4d49bd03ebaa049fd146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a98ca3-df95-4ac5-8071-490868ade63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a98ca3-df95-4ac5-8071-490868ade63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9a0889-9096-4d1f-bef7-d0963ce0b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9a0889-9096-4d1f-bef7-d0963ce0b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eba9c80-c909-45bd-ac7a-1d849152c71d', 'volume_name': 'volume-3eba9c80-c909-45bd-ac7a-1d849152c71d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb92e133-0c81-446e-9a4b-928aa3c60dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb92e133-0c81-446e-9a4b-928aa3c60dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57622b4e-6d85-43c5-8f8e-aa57ad544a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume 3eba9c80-c909-45bd-ac7a-1d849152c71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eba9c80-c909-45bd-ac7a-1d849152c71d', 'volume_size': 1} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:33 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 1.161s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:33 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 Jul 09 09:27:33 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:33 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 1 in 0.927s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Downloaded image 17164b93-88f8-4312-b50e-40fee296464d ((None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}])) to volume 06584ea0-a5f7-4054-8d59-31b0508924ee successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Temporary image 17164b93-88f8-4312-b50e-40fee296464d for user ba84fee0ff444b9bbc83248b077b5022 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Marking volume 06584ea0-a5f7-4054-8d59-31b0508924ee as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Copying metadata from image 17164b93-88f8-4312-b50e-40fee296464d to 06584ea0-a5f7-4054-8d59-31b0508924ee. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Creating volume glance metadata for volume 06584ea0-a5f7-4054-8d59-31b0508924ee backed by image 17164b93-88f8-4312-b50e-40fee296464d with: {'image_id': '17164b93-88f8-4312-b50e-40fee296464d', 'image_name': 'tempest-scenario-img--1975643773', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03e77c-2384-4989-9fc6-d21eec4a535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06584ea0-a5f7-4054-8d59-31b0508924ee', 'volume_size': 1, 'image_id': '17164b93-88f8-4312-b50e-40fee296464d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17164b93-88f8-4312-b50e-40fee296464d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1975643773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54709de35fd14fb18689ffd3414c223f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17164b93-88f8-4312-b50e-40fee296464d', 'created_at': datetime.datetime(2026, 7, 9, 7, 27, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 27, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17164b93-88f8-4312-b50e-40fee296464d/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764b591f-17f6-4988-8d71-aa9bebf18812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Volume volume-06584ea0-a5f7-4054-8d59-31b0508924ee (06584ea0-a5f7-4054-8d59-31b0508924ee): created successfully Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764b591f-17f6-4988-8d71-aa9bebf18812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Flow 'volume_create_manager' (ae751fd1-3a2b-4e65-a72e-6834387e1eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7fbf46e1-cac9-4b3e-bc76-cbbd69155e7d tempest-TestInstancesWithCinderVolumes-1799250398 None] Created volume successfully. Jul 09 09:27:39 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9" returned: 0 in 6.385s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b73c8-6afc-4261-8e32-533b4d6d1e90]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:39 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:39 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-106d756e-1f77-4ae6-8da7-4823f4ae473f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-106d756e-1f77-4ae6-8da7-4823f4ae473f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:INSERT=24,cinder:UPDATE=65,cinder:SELECT=72,cinder:DELETE=3 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=67,cinder:INSERT=22,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-quobyte-106d756e-1f77-4ae6-8da7-4823f4ae473f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-106d756e-1f77-4ae6-8da7-4823f4ae473f" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbad483-a1d7-477b-a0c9-27ff4cf7e56f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:40 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f Jul 09 09:27:40 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:40 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 1.137s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:27:40 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Converted 1024.00 MB image at 160.29 MB/s Jul 09 09:27:40 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 is being set with open permissions: ugo+rw Jul 09 09:27:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:41 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 Jul 09 09:27:41 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:41 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f" returned: 0 in 0.874s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:41 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f Jul 09 09:27:41 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:41 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" released by "_copy_volume_from_snapshot" :: held 10.719s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-quobyte-b2fd7a26-88c6-43e3-9d95-16db49c06cfc" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-b2fd7a26-88c6-43e3-9d95-16db49c06cfc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Deleting offline snapshot b2fd7a26-88c6-43e3-9d95-16db49c06cfc of volume 27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] snapshot_file for this snap is: volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c0010d-8298-4634-a06d-3421f3a43b97]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:41 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:41 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:41 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-106d756e-1f77-4ae6-8da7-4823f4ae473f" returned: 0 in 0.697s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-106d756e-1f77-4ae6-8da7-4823f4ae473f" released by "delete_volume" :: held 1.614s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Created reservations ['70c3e419-bad7-49bf-a026-bc449ec2c8c5', '46c3ab8e-2f71-41e0-bad0-2a457b681b97', 'f00a3743-c73b-4a58-a5a6-833415d87397', 'f434ec73-c53c-4268-8447-f4b4845a9647'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:42 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:42 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-81555772-183d-43f8-b795-6203b930bb58-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-81555772-183d-43f8-b795-6203b930bb58-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-quobyte-81555772-183d-43f8-b795-6203b930bb58" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:42 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 0.933s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27d38507-70de-4f8c-9414-4d3074c51e70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-81555772-183d-43f8-b795-6203b930bb58" acquired by "delete_volume" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[43789109-f961-49cb-b40f-49f79f13e2b1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0642f4-0655-4c5c-8066-6bd85a5f70a8]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:42 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:42 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:42 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 Jul 09 09:27:42 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:42 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Deleted volume successfully. Jul 09 09:27:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ecaf38c3-bbfd-4362-a483-f19045925abc tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-106d756e-1f77-4ae6-8da7-4823f4ae473f-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:43 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58" returned: 0 in 1.008s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:43 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58 Jul 09 09:27:43 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:43 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 1.161s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:43 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:43 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:44 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-81555772-183d-43f8-b795-6203b930bb58" returned: 0 in 0.779s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-81555772-183d-43f8-b795-6203b930bb58" released by "delete_volume" :: held 1.838s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Created reservations ['df31c088-00ff-4f77-b507-d0f4468b16c2', 'e6c17082-a0cc-43e3-baea-bd9e6d35b8ae', 'aaa4ed78-1b02-4160-89f6-850c79c81be9', '43234a3e-f2e5-4fd4-a2cf-2762c34c63f9'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:44 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:44 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:44 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 0.973s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:44 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc Jul 09 09:27:44 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "cinder-quobyte-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b533917e-95ab-4744-a6ee-e198bc3810e1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:45 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 Jul 09 09:27:45 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:45 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.940s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Deleted volume successfully. Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1bffbe17-adf4-451c-88d3-7a65cb32741b tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-81555772-183d-43f8-b795-6203b930bb58-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:45 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70.b2fd7a26-88c6-43e3-9d95-16db49c06cfc" returned: 0 in 1.030s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-b2fd7a26-88c6-43e3-9d95-16db49c06cfc" released by "_delete_snapshot" :: held 4.247s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.860s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.485s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-628309632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8ae354-4972-44ac-a876-6c73046073a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d821ef970d3c4621a4526d33342ee494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:32Z,use_quota=True,user_id='47b4067c75fb4d49bd03ebaa049fd146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Creating volume 5d8ae354-4972-44ac-a876-6c73046073a3 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:46 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:46 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 1073741824 Jul 09 09:27:46 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8495cf-bc3f-4a2f-9cb4-0feb7f2d1487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242baa37-9cbe-452c-acac-03a701897dd9', 'volume_size': 2, 'source_volid': '27d38507-70de-4f8c-9414-4d3074c51e70', 'source_volstatus': 'available'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a753cd19-eec5-4b50-add7-31ac32674352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Volume volume-242baa37-9cbe-452c-acac-03a701897dd9 (242baa37-9cbe-452c-acac-03a701897dd9): created successfully Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a753cd19-eec5-4b50-add7-31ac32674352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Flow 'volume_create_manager' (153c9717-63b4-4642-aa43-6f679cd1b39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2bed0489-5a21-45d1-be2b-a4964d6b9cdb tempest-VolumesCloneTest-1946227083 None] Created volume successfully. Jul 09 09:27:46 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" returned: 0 in 1.136s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:46 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2 Jul 09 09:27:46 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:47 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 1073741824" returned: 0 in 1.344s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:47 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" returned: 0 in 0.900s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-quobyte-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2" released by "delete_volume" :: held 2.152s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:47 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 Jul 09 09:27:47 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Created reservations ['62203539-c8fe-44c3-8dd3-5872f7eab887', 'daf43afd-b273-40b2-b9b7-3e4b3d2f99ff', '2a032410-7039-4e75-bd99-667c0635fe91', '1a3ebffa-71e0-42a1-ac6b-0040961928e0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-242baa37-9cbe-452c-acac-03a701897dd9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:47 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-242baa37-9cbe-452c-acac-03a701897dd9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:47 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e636f-5b5b-4ac1-855b-4747486ebff4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:48 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 Jul 09 09:27:48 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:48 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3" returned: 0 in 0.863s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.384s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1167228012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eba9c80-c909-45bd-ac7a-1d849152c71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d821ef970d3c4621a4526d33342ee494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:27:33Z,use_quota=True,user_id='47b4067c75fb4d49bd03ebaa049fd146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Creating volume 3eba9c80-c909-45bd-ac7a-1d849152c71d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:27:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da0768c-c09d-4be0-b0f9-3f39dd543bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8ae354-4972-44ac-a876-6c73046073a3', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a6dc24-2e1a-4ec4-a5ad-1a645d0171d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:48 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d 1073741824 Jul 09 09:27:48 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume volume-5d8ae354-4972-44ac-a876-6c73046073a3 (5d8ae354-4972-44ac-a876-6c73046073a3): created successfully Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a6dc24-2e1a-4ec4-a5ad-1a645d0171d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Flow 'volume_create_manager' (dfdb9898-dcd6-42f4-ae2a-156a42937210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d6add331-298d-44fd-b3e8-08d33ab362f3 tempest-TestServerVolumeAttachmentScenario-173126986 None] Created volume successfully. Jul 09 09:27:48 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.755s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Deleted volume successfully. Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92095415-7166-4753-8da2-6e8a0c46d307 tempest-AttachVolumeNegativeTest-689033810 None] Lock "cinder-65010c3c-4153-4c6f-8cc7-b70ea7dfecb2-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:48 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9" returned: 0 in 0.935s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:48 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9 Jul 09 09:27:48 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:49 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d 1073741824" returned: 0 in 0.959s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:49 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d Jul 09 09:27:49 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:49 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-242baa37-9cbe-452c-acac-03a701897dd9" returned: 0 in 0.789s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-242baa37-9cbe-452c-acac-03a701897dd9" released by "delete_volume" :: held 1.792s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Created reservations ['f7706c0a-294b-4c32-99ca-66c37296086a', 'b635575b-4516-4104-a076-4c358beb98a7', '5e1658d5-44fa-4823-b2d9-ab6d24034584', '5520cffd-60ba-443b-8fb0-59bfd70dd2b4'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:49 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:49 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-27d38507-70de-4f8c-9414-4d3074c51e70-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-27d38507-70de-4f8c-9414-4d3074c51e70-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:50 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.924s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "cinder-quobyte-27d38507-70de-4f8c-9414-4d3074c51e70" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57622b4e-6d85-43c5-8f8e-aa57ad544a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eba9c80-c909-45bd-ac7a-1d849152c71d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58905547-0e08-46dd-ab57-9701b9e5401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-27d38507-70de-4f8c-9414-4d3074c51e70" acquired by "delete_volume" :: waited 0.082s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f94b1c-68f5-443c-a0e1-5f26687b09dc]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e04ea6-2d61-4158-97dd-cdd967a9b08e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Volume volume-3eba9c80-c909-45bd-ac7a-1d849152c71d (3eba9c80-c909-45bd-ac7a-1d849152c71d): created successfully Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58905547-0e08-46dd-ab57-9701b9e5401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Flow 'volume_create_manager' (aa7df71a-5bb9-45b8-b82f-788a566d71c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-452a56e4-46dd-450d-900a-f125915c9e09 tempest-TestServerVolumeAttachmentScenario-173126986 None] Created volume successfully. Jul 09 09:27:50 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:50 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:50 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:50 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:50 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:50 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:51 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.334s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Deleted volume successfully. Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f731db26-4bbb-44ee-b0d8-2b7031dcd767 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-242baa37-9cbe-452c-acac-03a701897dd9-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:51 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.145s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:27:51 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 1.421s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:51 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 1.533s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:52 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70 Jul 09 09:27:52 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:52 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:27:52 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:52 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-27d38507-70de-4f8c-9414-4d3074c51e70" returned: 0 in 0.880s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-quobyte-27d38507-70de-4f8c-9414-4d3074c51e70" released by "delete_volume" :: held 2.527s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:27:52 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 1 in 1.124s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.699s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Created reservations ['8a509f77-55a8-4df4-b4e2-27891ba2f459', 'ab368f48-8a8f-49da-889a-097f8938085c', 'fdeeda09-893b-420f-bde0-9a36c2f225cc', '8b04a91b-378d-4e2a-a074-f200889c638a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-06584ea0-a5f7-4054-8d59-31b0508924ee', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2ac6a75-4ba3-49a7-bfe8-7e74e2840d31', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:27:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-cd808fc3-c6f8-4301-8867-295d326932c4 req-c116500f-ff05-4d1a-b9f9-94d1e9b87299 tempest-TestInstancesWithCinderVolumes-1799250398 None] attachment_update completed successfully. Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:27:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:27:53 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:27:53 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:27:54 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 09 09:27:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.125s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:27:54 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:27:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Deleted volume successfully. Jul 09 09:27:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ac06f2b5-cb93-4739-9896-b02bddb75f10 tempest-VolumesCloneTest-1946227083 None] Lock "cinder-27d38507-70de-4f8c-9414-4d3074c51e70-delete_volume" released by "delete_volume" :: held 4.107s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68a16c5b-d48e-444e-ab3e-49f3cebc7b28 tempest-GroupSnapshotsV319Test-1345153407 None] Group tempest-GroupSnapshotsV319Test-Group-145722973: creating Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Flow 'volume_create_manager' (314d71f7-d038-4ff7-b9b1-b3f3a6e40491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056fe97f-c302-41ca-9d93-0566ed50f40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056fe97f-c302-41ca-9d93-0566ed50f40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565752619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13972ee5-8d9c-4ad4-9619-1b22efa512da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ac9cd28a64f7fbaba038d036de2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:00Z,use_quota=True,user_id='824c69ae40f44b9fbd8160afbb3f0611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecf8432-b165-4341-94a9-331a3b2df163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecf8432-b165-4341-94a9-331a3b2df163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9429264-5bbf-465e-a052-bcd23aee2af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:00 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:28:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68a16c5b-d48e-444e-ab3e-49f3cebc7b28 tempest-GroupSnapshotsV319Test-1345153407 None] Group tempest-GroupSnapshotsV319Test-Group-145722973: created successfully Jul 09 09:28:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68a16c5b-d48e-444e-ab3e-49f3cebc7b28 tempest-GroupSnapshotsV319Test-1345153407 None] Create group completed successfully. Jul 09 09:28:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9429264-5bbf-465e-a052-bcd23aee2af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13972ee5-8d9c-4ad4-9619-1b22efa512da', 'volume_name': 'volume-13972ee5-8d9c-4ad4-9619-1b22efa512da', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252d4601-83ce-4682-b0c1-7a4e5e8fb81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252d4601-83ce-4682-b0c1-7a4e5e8fb81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53527a92-4376-46ad-9bfd-1df7fc0c844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:01 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Volume 13972ee5-8d9c-4ad4-9619-1b22efa512da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13972ee5-8d9c-4ad4-9619-1b22efa512da', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 09:28:01 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Trying to clone 13972ee5-8d9c-4ad4-9619-1b22efa512da from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:28:02 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Image download 20.69 MB at 20.69 MB/s Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f67264-0792-43c3-baff-e300394b238a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:02 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD Jul 09 09:28:02 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Flow 'volume_create_manager' (ca4607c7-3ff4-493b-9599-63de4c19a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0df155-a889-419a-b700-8a777aa0bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0df155-a889-419a-b700-8a777aa0bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1659507772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17940aee-456f-4632-8c3a-2d01510d3d27,host='devstack@QuobyteHD#QuobyteHD',id=28e9d3af-df97-4263-8185-7b6184dfdfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307563a9c924df9bd8fc4c84b6d7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:03Z,use_quota=True,user_id='9c98f0a3f36b438bb79cfaf8c2042555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5413276a-7386-45d7-a662-07449b8016ca),volume_type_id=5413276a-7386-45d7-a662-07449b8016ca)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20c2734-459d-4d96-9080-ea3bf921db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20c2734-459d-4d96-9080-ea3bf921db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e759a604-2602-4b9f-974d-118b8fd781f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e759a604-2602-4b9f-974d-118b8fd781f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e9d3af-df97-4263-8185-7b6184dfdfba', 'volume_name': 'volume-28e9d3af-df97-4263-8185-7b6184dfdfba', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969af5fb-44fd-4f20-893f-46823b1f56aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969af5fb-44fd-4f20-893f-46823b1f56aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c87d0c-08df-413c-9b94-920a676c2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Volume 28e9d3af-df97-4263-8185-7b6184dfdfba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e9d3af-df97-4263-8185-7b6184dfdfba', 'volume_size': 1} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17940aee-456f-4632-8c3a-2d01510d3d27,created_at=2026-07-09T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1659507772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17940aee-456f-4632-8c3a-2d01510d3d27,host='devstack@QuobyteHD#QuobyteHD',id=28e9d3af-df97-4263-8185-7b6184dfdfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a307563a9c924df9bd8fc4c84b6d7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:03Z,use_quota=True,user_id='9c98f0a3f36b438bb79cfaf8c2042555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5413276a-7386-45d7-a662-07449b8016ca),volume_type_id=5413276a-7386-45d7-a662-07449b8016ca)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Creating volume 28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:03 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:03 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba 1073741824 Jul 09 09:28:03 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:04 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD" returned: 0 in 1.916s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 is fetched for user 824c69ae40f44b9fbd8160afbb3f0611. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973118f-7fcb-4c0d-a7d5-1dfa783dd72d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:04 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD Jul 09 09:28:04 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:04 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba 1073741824" returned: 0 in 1.817s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:04 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba Jul 09 09:28:04 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:05 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD" returned: 0 in 1.130s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:06 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba" returned: 0 in 1.311s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] <== create_volume: return (3234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.240s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565752619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13972ee5-8d9c-4ad4-9619-1b22efa512da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ac9cd28a64f7fbaba038d036de2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:00Z,use_quota=True,user_id='824c69ae40f44b9fbd8160afbb3f0611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Creating volume 13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:06 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c87d0c-08df-413c-9b94-920a676c2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e9d3af-df97-4263-8185-7b6184dfdfba', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:06 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1073741824 Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dda8cc-b855-45cf-b113-88a0091e2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:06 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:06 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Volume volume-28e9d3af-df97-4263-8185-7b6184dfdfba (28e9d3af-df97-4263-8185-7b6184dfdfba): created successfully Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dda8cc-b855-45cf-b113-88a0091e2a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Flow 'volume_create_manager' (ca4607c7-3ff4-493b-9599-63de4c19a142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-526b1e56-598a-4f25-8763-184550c5ce65 tempest-GroupSnapshotsV319Test-1345153407 None] Created volume successfully. Jul 09 09:28:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] GroupSnapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: creating. Jul 09 09:28:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Group snapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: creating. {{(pid=87265) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 09:28:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:07 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1073741824" returned: 0 in 1.645s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:08 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:08 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:08 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.111s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Creating offline snapshot 801afc84-388a-4a70-b2bc-25694141093c of volume 28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff8ebb-514f-4a5b-9462-df0a6b525815]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Attempting download of 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 13972ee5-8d9c-4ad4-9619-1b22efa512da. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ba22d-3645-4523-828c-d826b214a625]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:08 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba Jul 09 09:28:08 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:09 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw Jul 09 09:28:09 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:09 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba" returned: 0 in 0.903s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:09 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c 1G Jul 09 09:28:09 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:09 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw" returned: 0 in 1.007s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:10 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw Jul 09 09:28:10 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:10 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c 1G" returned: 0 in 0.990s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e9d3af-df97-4263-8185-7b6184dfdfba -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw" returned: 1 in 0.872s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_2l0yjitw' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:28:10 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:10 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e9d3af-df97-4263-8185-7b6184dfdfba -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca303e-1649-44c6-9d58-49833f9b1d1b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:10 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:10 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD Jul 09 09:28:10 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:11 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:11 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] 7c391f23-175f-4461-b6ef-8981ab0baaf6 was qcow2, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:28:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:11 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28e9d3af-df97-4263-8185-7b6184dfdfba -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c" returned: 0 in 1.002s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:11 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:28:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:11 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:11 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:11 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c Jul 09 09:28:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:12 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c" returned: 0 in 0.735s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:12 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info Jul 09 09:28:12 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:13 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:13 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:13 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info Jul 09 09:28:13 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:13 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 1.984s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_y6n5kcardevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:28:13 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Converted 112.00 MB image at 56.41 MB/s Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:13 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1G Jul 09 09:28:13 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:13 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.info" returned: 0 in 0.662s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.162s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-02f5f412-7135-455e-a1bf-29c8b8463d8a tempest-GroupSnapshotsV319Test-1345153407 None] group_snapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: created successfully Jul 09 09:28:14 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 1G" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[197bb026-93df-4bdb-9b91-b31f57e4818f]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:14 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:14 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:15 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 0.907s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:15 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:15 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] group_snapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: deleting Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] group_snapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: deleting {{(pid=87265) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "cinder-quobyte-801afc84-388a-4a70-b2bc-25694141093c" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-801afc84-388a-4a70-b2bc-25694141093c" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Deleting offline snapshot 801afc84-388a-4a70-b2bc-25694141093c of volume 28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] snapshot_file for this snap is: volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c0931-f50e-4793-87d0-c78f0e79da94]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:16 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c Jul 09 09:28:16 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:16 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 1 in 1.211s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Downloaded image 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume 13972ee5-8d9c-4ad4-9619-1b22efa512da successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 for user 824c69ae40f44b9fbd8160afbb3f0611 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Marking volume 13972ee5-8d9c-4ad4-9619-1b22efa512da as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Copying metadata from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 to 13972ee5-8d9c-4ad4-9619-1b22efa512da. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Creating volume glance metadata for volume 13972ee5-8d9c-4ad4-9619-1b22efa512da backed by image 7c391f23-175f-4461-b6ef-8981ab0baaf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53527a92-4376-46ad-9bfd-1df7fc0c844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13972ee5-8d9c-4ad4-9619-1b22efa512da', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbdda0c-d193-4d67-a179-5608f3bed587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Volume volume-13972ee5-8d9c-4ad4-9619-1b22efa512da (13972ee5-8d9c-4ad4-9619-1b22efa512da): created successfully Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbdda0c-d193-4d67-a179-5608f3bed587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Flow 'volume_create_manager' (314d71f7-d038-4ff7-b9b1-b3f3a6e40491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0ade7812-8659-4b01-a1df-06772fa37278 tempest-VolumesExtendTest-865480689 None] Created volume successfully. Jul 09 09:28:16 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c" returned: 0 in 1.015s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28e9d3af-df97-4263-8185-7b6184dfdfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[75198cf1-0d9b-4fd4-84ad-67a84a483bc0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:17 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba Jul 09 09:28:17 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54dc3c8-58db-497d-9ecd-491b6ef3746a]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:17 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:17 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:18 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba" returned: 0 in 0.975s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:18 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c Jul 09 09:28:18 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:18 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 0.888s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:18 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:18 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:18 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c" returned: 0 in 0.823s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:18 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c Jul 09 09:28:18 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:19 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 1 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 2G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da 2G" returned: 0 in 0.062s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.842s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0e29c54b-2372-4331-80a6-2baf79190dc1 tempest-VolumesExtendTest-865480689 None] Extend volume completed successfully. Jul 09 09:28:19 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba.801afc84-388a-4a70-b2bc-25694141093c" returned: 0 in 0.645s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-801afc84-388a-4a70-b2bc-25694141093c" released by "_delete_snapshot" :: held 3.661s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" released by "delete_snapshot" :: held 3.718s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:19 devstack cinder-volume[87265]: WARNING cinder.quota [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-953792422 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-953792422, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:19 devstack cinder-volume[87265]: WARNING cinder.quota [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-953792422 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-953792422, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] Created reservations ['9cc6a643-3d25-4a0d-9b1c-8bc408432853', 'd7ebeba3-cc7c-4e59-9dea-92478bc8d363', 'e5fc490a-37ed-4636-8f38-9ada34268667', '2b0badaf-5c99-45f2-8f85-bd8ec1cc1e5e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c0a5652e-b77d-4594-9a08-0a9d63604285 tempest-GroupSnapshotsV319Test-1345153407 None] group_snapshot b04b7121-72a1-447f-b5e4-ba4f716ce67f: deleted successfully Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-13972ee5-8d9c-4ad4-9619-1b22efa512da-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "cinder-13972ee5-8d9c-4ad4-9619-1b22efa512da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-quobyte-13972ee5-8d9c-4ad4-9619-1b22efa512da" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-13972ee5-8d9c-4ad4-9619-1b22efa512da" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[180843fc-26d2-4e71-92df-47e9c16c05e9]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:19 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:19 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[95284e65-5703-49c2-83f1-baa451c44171]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:20 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 0.778s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:20 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba Jul 09 09:28:20 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:20 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:20 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:21 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:21 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 1 in 0.771s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:28:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:21 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba Jul 09 09:28:21 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:21 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da Jul 09 09:28:21 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:22 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-28e9d3af-df97-4263-8185-7b6184dfdfba" returned: 0 in 0.673s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:22 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-13972ee5-8d9c-4ad4-9619-1b22efa512da" returned: 0 in 0.675s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "cinder-quobyte-28e9d3af-df97-4263-8185-7b6184dfdfba" released by "delete_volume" :: held 1.557s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-13972ee5-8d9c-4ad4-9619-1b22efa512da" released by "delete_volume" :: held 2.295s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Created reservations ['7ad6371b-1cb7-4e60-8c01-31bc9bf3c833', 'd4e661c9-fe3a-4e00-a104-4287d6c1926b', '32bde422-658c-45ea-b11e-1a1231546054', 'cf6bab5e-bf78-4c65-81fb-14532c88b3f2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Created reservations ['14d456b8-9619-4830-81b3-75790ded3b62'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:22 devstack cinder-volume[87265]: WARNING cinder.quota [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-953792422 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-953792422, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Created reservations ['55788b00-139a-419b-9c45-b1affd83cbec', 'f6d0b8d3-e825-4a42-b642-a3b62ec7a58d', 'cd6f94d3-4574-43d1-8a25-e95042957155', '9f958701-a48b-48a5-9353-bd88516566a7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:22 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:22 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:22 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:22 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:22 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.670s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Deleted volume successfully. Jul 09 09:28:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-91b1b389-b646-419c-ad21-f9fa58d4a387 tempest-VolumesExtendTest-865480689 None] Lock "cinder-13972ee5-8d9c-4ad4-9619-1b22efa512da-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:23 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.681s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:23 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cc7fcb10-4bea-4bae-9951-5d977f91de21 tempest-GroupSnapshotsV319Test-1345153407 None] Delete group completed successfully. Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdabc9a1-e469-4641-b41a-65b864916501]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:23 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 Jul 09 09:28:23 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Flow 'volume_create_manager' (4cb8f017-8f30-446f-b4c6-725607f0093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d773d-d813-4ae9-9002-bc2643ca8852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d773d-d813-4ae9-9002-bc2643ca8852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1065230670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0674fa70-afbf-4295-b588-9f2dd4e21e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ac9cd28a64f7fbaba038d036de2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:24Z,use_quota=True,user_id='824c69ae40f44b9fbd8160afbb3f0611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafb8895-c3ed-4dbc-aab2-707a35981c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafb8895-c3ed-4dbc-aab2-707a35981c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477d0833-f3ba-4e0c-87c3-b41ac586eb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477d0833-f3ba-4e0c-87c3-b41ac586eb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0674fa70-afbf-4295-b588-9f2dd4e21e2e', 'volume_name': 'volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfda976-43e3-4d2b-8201-f28b43164083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfda976-43e3-4d2b-8201-f28b43164083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553fa9a-09c0-4616-aeaa-f8450ee91dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:23 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Volume 0674fa70-afbf-4295-b588-9f2dd4e21e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e', 'volume_size': 1} Jul 09 09:28:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:24 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3" returned: 0 in 0.979s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1065230670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0674fa70-afbf-4295-b588-9f2dd4e21e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ac9cd28a64f7fbaba038d036de2e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:24Z,use_quota=True,user_id='824c69ae40f44b9fbd8160afbb3f0611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Creating volume 0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:24 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e 1073741824 Jul 09 09:28:24 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-5d8ae354-4972-44ac-a876-6c73046073a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2da8bc55-a9e4-4891-862a-6cc84cad9978', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:28:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-e5709f96-5c71-4518-84d7-e2dda7d05490 req-0a718f3b-31e3-4e68-90c7-be618aa136f7 tempest-TestServerVolumeAttachmentScenario-173126986 None] attachment_update completed successfully. Jul 09 09:28:25 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e 1073741824" returned: 0 in 1.102s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:25 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:25 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:26 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.778s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553fa9a-09c0-4616-aeaa-f8450ee91dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728d5841-eaf2-4bc9-ba69-3c7ae7caabcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Volume volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e (0674fa70-afbf-4295-b588-9f2dd4e21e2e): created successfully Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728d5841-eaf2-4bc9-ba69-3c7ae7caabcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Flow 'volume_create_manager' (4cb8f017-8f30-446f-b4c6-725607f0093c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:26 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-435a0509-2bb9-4f45-8a4f-209604f82f84 tempest-VolumesExtendTest-865480689 None] Created volume successfully. Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Creating offline snapshot eff6628d-9770-49aa-bcd1-96bfcf74dcc5 of volume 0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beda4fe-f154-47d0-a681-27fac4667c69]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:27 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:27 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:27 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.783s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:27 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 1G Jul 09 09:28:27 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-655dd1a8-eff7-4f07-8309-f2b20b4866c0 tempest-GroupsTest-378071709 None] Group tempest-Group1-1383655982: creating Jul 09 09:28:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-655dd1a8-eff7-4f07-8309-f2b20b4866c0 tempest-GroupsTest-378071709 None] Group tempest-Group1-1383655982: created successfully Jul 09 09:28:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-655dd1a8-eff7-4f07-8309-f2b20b4866c0 tempest-GroupsTest-378071709 None] Create group completed successfully. Jul 09 09:28:28 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 1G" returned: 0 in 0.888s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:28 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 Jul 09 09:28:28 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:29 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5" returned: 0 in 0.707s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:29 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 is being set with open permissions: ugo+rw Jul 09 09:28:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:29 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 Jul 09 09:28:29 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fe45db63-b15d-4e57-b67a-d0bca5707e57 tempest-GroupsTest-378071709 None] Group tempest-Group2-687914631: creating Jul 09 09:28:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fe45db63-b15d-4e57-b67a-d0bca5707e57 tempest-GroupsTest-378071709 None] Group tempest-Group2-687914631: created successfully Jul 09 09:28:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fe45db63-b15d-4e57-b67a-d0bca5707e57 tempest-GroupsTest-378071709 None] Create group completed successfully. Jul 09 09:28:30 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5" returned: 0 in 0.664s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:30 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info Jul 09 09:28:30 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:30 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:30 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info is being set with open permissions: ugo+rw Jul 09 09:28:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:30 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info Jul 09 09:28:30 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (ce809e64-c86a-43d5-ae13-178d9dbf530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31592ae8-8987-4ecd-9679-b5d5b3212e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31592ae8-8987-4ecd-9679-b5d5b3212e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318016385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ebae3e-9514-4cd6-afe8-5cd0557e027e,host='devstack@QuobyteHD#QuobyteHD',id=cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:31Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de51ec58-4586-4c28-9f45-db83c1b391e7),volume_type_id=de51ec58-4586-4c28-9f45-db83c1b391e7)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:31 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbcbd7f-538d-4912-ba92-5d442421d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbcbd7f-538d-4912-ba92-5d442421d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dc54a0-82c1-477c-9477-5e18848136de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0dc54a0-82c1-477c-9477-5e18848136de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9', 'volume_name': 'volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07decfdf-ec0b-446f-aad8-0db44c33b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07decfdf-ec0b-446f-aad8-0db44c33b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a84072-a897-41bf-9901-9ebb867e5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:31 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Volume cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9', 'volume_size': 1} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.info" returned: 0 in 0.801s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1ebae3e-9514-4cd6-afe8-5cd0557e027e,created_at=2026-07-09T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318016385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ebae3e-9514-4cd6-afe8-5cd0557e027e,host='devstack@QuobyteHD#QuobyteHD',id=cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:31Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de51ec58-4586-4c28-9f45-db83c1b391e7),volume_type_id=de51ec58-4586-4c28-9f45-db83c1b391e7)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Creating volume cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:31 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:31 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 1073741824 Jul 09 09:28:31 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fcc5d385-e62d-473d-af6d-886c18cd670d tempest-VolumesExtendTest-865480689 None] Create snapshot completed successfully Jul 09 09:28:32 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 1073741824" returned: 0 in 0.880s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:32 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 Jul 09 09:28:32 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:33 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" returned: 0 in 0.651s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.604s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a84072-a897-41bf-9901-9ebb867e5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53950d3-4848-4abb-a861-a0d186597b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d08708-7062-49a7-9bbd-05ee95dc1a4d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Volume volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 (cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9): created successfully Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53950d3-4848-4abb-a861-a0d186597b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (ce809e64-c86a-43d5-ae13-178d9dbf530b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2fe7dd35-26eb-40a8-963f-194c634a0007 tempest-GroupsTest-378071709 None] Created volume successfully. Jul 09 09:28:33 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:33 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:34 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.826s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 2G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 2G" returned: 0 in 0.157s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.039s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.094s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e5eba-0fc0-4331-afea-277d6a97db01]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e4fd1103-8ab8-43b8-970b-04c21c5b8df2 tempest-VolumesExtendTest-865480689 None] Extend volume completed successfully. Jul 09 09:28:34 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 Jul 09 09:28:34 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Acquiring lock "cinder-quobyte-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab2203-8b82-42a7-8561-6ece8b3d52ec]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:34 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 Jul 09 09:28:34 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-eff6628d-9770-49aa-bcd1-96bfcf74dcc5-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-eff6628d-9770-49aa-bcd1-96bfcf74dcc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-quobyte-eff6628d-9770-49aa-bcd1-96bfcf74dcc5" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-eff6628d-9770-49aa-bcd1-96bfcf74dcc5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Deleting offline snapshot eff6628d-9770-49aa-bcd1-96bfcf74dcc5 of volume 0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] snapshot_file for this snap is: volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[46698d17-29fc-483f-ad0c-46e58a9feb9d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:35 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3" returned: 0 in 0.830s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ebbc32-afd2-4222-ab2b-48207bc7777f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-6b19e703-8f30-434a-bab4-2d709c752ac3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ffbe1e3-dbd8-4a06-903d-da1e037898f2', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:28:35 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 Jul 09 09:28:35 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-d003ab3f-7464-4518-9da9-4dc1184f6c74 req-c60f4be5-e199-408c-8af0-cb1f69e694b0 tempest-TestInstancesWithCinderVolumes-1799250398 None] attachment_update completed successfully. Jul 09 09:28:35 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d Jul 09 09:28:35 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:35 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" returned: 0 in 0.846s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:35 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9 Jul 09 09:28:35 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:35 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5" returned: 0 in 0.838s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb5c8ec-2920-49a2-be0f-2ffb53644938]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:36 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d" returned: 0 in 0.898s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.919s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-3eba9c80-c909-45bd-ac7a-1d849152c71d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41358a0b-526d-48fb-9097-2a4d6e69cba2', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:28:36 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:36 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-d117a903-50e1-419b-9e57-1e23b7192c01 req-e24edd2b-2cbd-4922-93a1-7adacfb03900 tempest-TestServerVolumeAttachmentScenario-173126986 None] attachment_update completed successfully. Jul 09 09:28:36 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" returned: 0 in 0.692s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-cfbe2bf3-fb0d-47dc-88a0-d06d5fca3bc9" released by "delete_volume" :: held 1.590s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Created reservations ['407ab350-bbac-43b3-99f1-a3f8df86e04c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:36 devstack cinder-volume[87265]: WARNING cinder.quota [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2103955723 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2103955723, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:36 devstack cinder-volume[87265]: WARNING cinder.quota [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2103955723 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2103955723, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Created reservations ['e38d1b00-8ae1-4dfc-921a-57e11c127859', '5afadbfe-b9b9-4afc-84f4-f68bd3aa79b3', '279255c3-550c-40f6-b3ee-30adae63561d', 'b387bde3-e89e-4a60-b343-a5db6a1af6af'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:36 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:36 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:36 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.795s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:36 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 Jul 09 09:28:36 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:37 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.683s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-adc0f5b6-0ce0-4470-ba7f-fe021895de46 tempest-GroupsTest-378071709 None] Delete group completed successfully. Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Created reservations ['ebad4118-d430-4cce-b283-15d133756503'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:37 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:37 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:37 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5" returned: 0 in 0.881s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:37 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5 Jul 09 09:28:37 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:37 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.697s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:37 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23aa3dc8-17dd-48c7-945c-49bd1ad34939 tempest-GroupsTest-378071709 None] Delete group completed successfully. Jul 09 09:28:38 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e.eff6628d-9770-49aa-bcd1-96bfcf74dcc5" returned: 0 in 0.668s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-eff6628d-9770-49aa-bcd1-96bfcf74dcc5" released by "_delete_snapshot" :: held 3.343s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" released by "delete_snapshot" :: held 3.373s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Created reservations ['3994764e-798d-4c56-8950-f58cf0c98691', '880c46c6-871f-433e-b0f1-342c91fe3c0b', 'ed1376f3-eb9d-4f1b-8fe9-7bb2db35f7ce', '6f41ee13-d282-4c2c-b9af-ba34a4907abd'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Delete snapshot completed successfully. Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7714a59-925f-48ae-9231-f4924767b688 tempest-VolumesExtendTest-865480689 None] Lock "cinder-eff6628d-9770-49aa-bcd1-96bfcf74dcc5-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2bc120ea-c537-4823-9644-6053905fa41b tempest-GroupsTest-378071709 None] Group tempest-GroupsTest-Group-354458794: creating Jul 09 09:28:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2bc120ea-c537-4823-9644-6053905fa41b tempest-GroupsTest-378071709 None] Group tempest-GroupsTest-Group-354458794: created successfully Jul 09 09:28:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2bc120ea-c537-4823-9644-6053905fa41b tempest-GroupsTest-378071709 None] Create group completed successfully. Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-0674fa70-afbf-4295-b588-9f2dd4e21e2e-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "cinder-0674fa70-afbf-4295-b588-9f2dd4e21e2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Acquiring lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:39 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bd26a-a071-4a81-b092-0d9939302c18]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:39 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:39 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:39 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.765s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:39 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e Jul 09 09:28:39 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=116,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=133,cinder:UPDATE=131,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (38cfc907-fb71-465f-876e-6d6888585599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df6a83-0faa-45f4-b49e-d99a53a73c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df6a83-0faa-45f4-b49e-d99a53a73c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081201146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,host='devstack@QuobyteHD#QuobyteHD',id=4da6d2b3-d75e-43ba-9209-b1093fe223c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:40Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffee4c26-9612-4860-afd8-149b2c7862e2),volume_type_id=ffee4c26-9612-4860-afd8-149b2c7862e2)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f594d27d-f0fa-4221-9677-bc145001aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f594d27d-f0fa-4221-9677-bc145001aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec88a9ea-5631-4399-b8ea-dab6c60b74f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec88a9ea-5631-4399-b8ea-dab6c60b74f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da6d2b3-d75e-43ba-9209-b1093fe223c7', 'volume_name': 'volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afde7517-f56b-40c2-94c5-3b0fe7d7f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afde7517-f56b-40c2-94c5-3b0fe7d7f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977ad310-0845-42f4-a26c-ca1fc6620a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Volume 4da6d2b3-d75e-43ba-9209-b1093fe223c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7', 'volume_size': 1} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,created_at=2026-07-09T07:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081201146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,host='devstack@QuobyteHD#QuobyteHD',id=4da6d2b3-d75e-43ba-9209-b1093fe223c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:40Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffee4c26-9612-4860-afd8-149b2c7862e2),volume_type_id=ffee4c26-9612-4860-afd8-149b2c7862e2)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Creating volume 4da6d2b3-d75e-43ba-9209-b1093fe223c7 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:40 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:40 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0674fa70-afbf-4295-b588-9f2dd4e21e2e" returned: 0 in 0.788s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:40 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 1073741824 Jul 09 09:28:40 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "cinder-quobyte-0674fa70-afbf-4295-b588-9f2dd4e21e2e" released by "delete_volume" :: held 1.623s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Created reservations ['6902a204-ea54-4b32-9eb0-3d3cd5edc145', '3a20a769-594f-45eb-a852-9acbf4dd3392', 'bc1ddc1b-0b79-4f9d-8a0a-b518d756bcee', '88bd8a00-20c1-48d8-9eff-fe74cc1a8e32'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:40 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:40 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:41 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.686s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Deleted volume successfully. Jul 09 09:28:41 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 1073741824" returned: 0 in 0.885s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d4a7f8ca-e089-48a5-b18f-14a0c7272909 tempest-VolumesExtendTest-865480689 None] Lock "cinder-0674fa70-afbf-4295-b588-9f2dd4e21e2e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:41 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 Jul 09 09:28:41 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-f37e2dbd-3afc-40ae-908f-ffef7cf394dc req-397241e0-87ba-4da6-97ae-841c08b84dd4 tempest-TestServerVolumeAttachmentScenario-173126986 None] Terminate volume connection completed successfully. Jul 09 09:28:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-f37e2dbd-3afc-40ae-908f-ffef7cf394dc req-397241e0-87ba-4da6-97ae-841c08b84dd4 tempest-TestServerVolumeAttachmentScenario-173126986 None] Deleting attachment 41358a0b-526d-48fb-9097-2a4d6e69cba2. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:28:42 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977ad310-0845-42f4-a26c-ca1fc6620a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04947809-b4d7-4f58-a6a4-6ed9c71bdcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Volume volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 (4da6d2b3-d75e-43ba-9209-b1093fe223c7): created successfully Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04947809-b4d7-4f58-a6a4-6ed9c71bdcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (38cfc907-fb71-465f-876e-6d6888585599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d22cf891-de6c-4623-a37b-88183700c7e0 tempest-GroupsTest-378071709 None] Created volume successfully. Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d1202-3f5e-45e9-b885-99a0840226d2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:43 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 Jul 09 09:28:43 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (26e1ad1c-356f-4296-afe5-bfa082a1c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebbebd4-3076-4993-a38a-67820696dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebbebd4-3076-4993-a38a-67820696dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522387592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,host='devstack@QuobyteHD#QuobyteHD',id=b05f0fc4-1619-46dc-957e-9bc99b626c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:43Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffee4c26-9612-4860-afd8-149b2c7862e2),volume_type_id=ffee4c26-9612-4860-afd8-149b2c7862e2)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1f80e9-6339-44b9-8ff4-4fd686f7317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1f80e9-6339-44b9-8ff4-4fd686f7317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfb911a-0ec4-484e-a4ae-c7eb434696de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfb911a-0ec4-484e-a4ae-c7eb434696de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05f0fc4-1619-46dc-957e-9bc99b626c76', 'volume_name': 'volume-b05f0fc4-1619-46dc-957e-9bc99b626c76', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c0617-64e0-4d08-90e6-af7c0996971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c0617-64e0-4d08-90e6-af7c0996971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a983bb6-f946-42c1-b026-c2a83f718ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:43 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Volume b05f0fc4-1619-46dc-957e-9bc99b626c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05f0fc4-1619-46dc-957e-9bc99b626c76', 'volume_size': 1} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:43 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6" returned: 0 in 0.931s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,created_at=2026-07-09T07:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522387592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6660ceb0-dc3e-4488-bb8f-771103a1bc68,host='devstack@QuobyteHD#QuobyteHD',id=b05f0fc4-1619-46dc-957e-9bc99b626c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b0e8a8bdd4fe4b83c3912e066df60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:43Z,use_quota=True,user_id='04ab053164fa46f29047c5667cd54461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffee4c26-9612-4860-afd8-149b2c7862e2),volume_type_id=ffee4c26-9612-4860-afd8-149b2c7862e2)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Creating volume b05f0fc4-1619-46dc-957e-9bc99b626c76 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:43 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:43 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 1073741824 Jul 09 09:28:43 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-38532dfb-54c9-4343-a1af-219acb1b07e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85ef83b2-bf16-463f-92f7-afa517070323', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:28:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-a0079d6e-d799-4f52-b8bb-9f27b334fea6 req-39b6b494-e985-4727-81f2-69717701c6b4 tempest-TestInstancesWithCinderVolumes-1799250398 None] attachment_update completed successfully. Jul 09 09:28:44 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 1073741824" returned: 0 in 0.983s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:44 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 Jul 09 09:28:44 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:45 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76" returned: 0 in 0.766s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a983bb6-f946-42c1-b026-c2a83f718ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05f0fc4-1619-46dc-957e-9bc99b626c76', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a304d27-266d-43fd-ac63-3560e023a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:45 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Volume volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 (b05f0fc4-1619-46dc-957e-9bc99b626c76): created successfully Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a304d27-266d-43fd-ac63-3560e023a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Flow 'volume_create_manager' (26e1ad1c-356f-4296-afe5-bfa082a1c23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-b20e203e-fa7a-4490-9789-b6253f908095 req-26e970c8-701e-430a-8feb-91417b95a199 tempest-TestServerVolumeAttachmentScenario-173126986 None] Terminate volume connection completed successfully. Jul 09 09:28:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-b20e203e-fa7a-4490-9789-b6253f908095 req-26e970c8-701e-430a-8feb-91417b95a199 tempest-TestServerVolumeAttachmentScenario-173126986 None] Deleting attachment 2da8bc55-a9e4-4891-862a-6cc84cad9978. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:28:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d2649fbb-22b8-42ef-80fc-ce1ed84a0d2d tempest-GroupsTest-378071709 None] Created volume successfully. Jul 09 09:28:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9ab08e44-adb4-44ed-9ff9-15c3fb257819 tempest-GroupsTest-378071709 None] Update group completed successfully. Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Flow 'volume_create_manager' (24db727f-15a7-4328-9bd4-5a2340728eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfa0f3c-a584-4aea-98e2-c20ae73fbc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfa0f3c-a584-4aea-98e2-c20ae73fbc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1015202140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82784de3-707a-42d1-81ab-4a1ea5b21eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092affb22e834b39b81f153217cbce04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:47Z,use_quota=True,user_id='285dac9ec443494f90c50d014720586e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dadd6c-64e4-45d0-9946-c09dcd512ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dadd6c-64e4-45d0-9946-c09dcd512ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825287f-4afb-48ef-a223-943200105087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825287f-4afb-48ef-a223-943200105087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82784de3-707a-42d1-81ab-4a1ea5b21eb9', 'volume_name': 'volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9', 'volume_size': 2}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d0a80a-a980-4f04-bfbb-378e0ac69867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d0a80a-a980-4f04-bfbb-378e0ac69867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901886a5-8f7c-4e0f-9bc2-bc7034bc1d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:47 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Volume 82784de3-707a-42d1-81ab-4a1ea5b21eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9', 'volume_size': 2} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1015202140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82784de3-707a-42d1-81ab-4a1ea5b21eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092affb22e834b39b81f153217cbce04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:28:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:28:47Z,use_quota=True,user_id='285dac9ec443494f90c50d014720586e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Creating volume 82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:28:47 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:28:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 2147483648 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:47 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 2147483648 Jul 09 09:28:47 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1fdc297b-365b-4384-b06a-0ac866b7f3f7 tempest-GroupsTest-378071709 None] Update group completed successfully. Jul 09 09:28:48 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 2147483648" returned: 0 in 0.977s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:48 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 Jul 09 09:28:48 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:48 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9" returned: 0 in 0.685s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901886a5-8f7c-4e0f-9bc2-bc7034bc1d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9', 'volume_size': 2}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9d581e-01e8-49db-ba9b-e61bd1f01a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:28:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Volume volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 (82784de3-707a-42d1-81ab-4a1ea5b21eb9): created successfully Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9d581e-01e8-49db-ba9b-e61bd1f01a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:28:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Flow 'volume_create_manager' (24db727f-15a7-4328-9bd4-5a2340728eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:28:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8aac70f3-f508-4437-b053-3c445f68768f tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Created volume successfully. Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Acquiring lock "cinder-quobyte-4da6d2b3-d75e-43ba-9209-b1093fe223c7" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-4da6d2b3-d75e-43ba-9209-b1093fe223c7" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f764363-7189-47ad-9e5d-fb365e1aaf73]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:49 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 Jul 09 09:28:49 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Creating offline snapshot cf094645-30c2-4db2-aa60-d0555953327e of volume 82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63c1ac-8414-4c5b-8838-fdf11273f38f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:49 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 Jul 09 09:28:49 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:50 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7" returned: 0 in 1.101s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:50 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7 Jul 09 09:28:50 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:50 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:50 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:50 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9" returned: 0 in 1.142s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e 2G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:50 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e 2G Jul 09 09:28:50 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:51 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4da6d2b3-d75e-43ba-9209-b1093fe223c7" returned: 0 in 1.054s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-4da6d2b3-d75e-43ba-9209-b1093fe223c7" released by "delete_volume" :: held 2.219s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Acquiring lock "cinder-quobyte-b05f0fc4-1619-46dc-957e-9bc99b626c76" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-b05f0fc4-1619-46dc-957e-9bc99b626c76" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7df198c-a23c-4edb-a533-47e3c7a7f971]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:51 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.115s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:28:51 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 Jul 09 09:28:51 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:51 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e 2G" returned: 0 in 1.086s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:51 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e Jul 09 09:28:51 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:52 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76" returned: 0 in 0.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:52 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76 Jul 09 09:28:52 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:52 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e" returned: 0 in 0.771s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:52 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e is being set with open permissions: ugo+rw Jul 09 09:28:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:52 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e Jul 09 09:28:52 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:53 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b05f0fc4-1619-46dc-957e-9bc99b626c76" returned: 0 in 0.655s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "cinder-quobyte-b05f0fc4-1619-46dc-957e-9bc99b626c76" released by "delete_volume" :: held 1.640s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Created reservations ['9b972f2a-7e11-40e9-aa55-c20ba9f93bf8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:53 devstack cinder-volume[87265]: WARNING cinder.quota [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1440650280 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1440650280, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:53 devstack cinder-volume[87265]: WARNING cinder.quota [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1440650280 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1440650280, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Created reservations ['d13b0d0f-26d5-45ce-8d1e-42095c029fdf', 'ddf0fe96-cfb2-4075-93c3-334e909aa7ca', '6ae116a6-c158-4143-82fc-97ab75705040', '1a016067-1412-4d90-9876-c2e48b40bea3'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:53 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e" returned: 0 in 0.707s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:53 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info Jul 09 09:28:53 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Created reservations ['cefa8f2e-70b4-463d-a053-54991319097d', 'd9865786-74c7-4aae-8523-a1cdd029ec9b', 'cb8dd9cb-c1f8-4857-8d6a-4fd14a8c4eee', '84834c0a-ce81-470e-a7de-8c79d81f6e9e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:53 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:53 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-fff4b40a-9060-4c24-ad24-0ee037e76842 req-b6e19ba2-489f-48d0-ae36-7610f3caa4de tempest-TestInstancesWithCinderVolumes-1799250398 None] Terminate volume connection completed successfully. Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-fff4b40a-9060-4c24-ad24-0ee037e76842 req-b6e19ba2-489f-48d0-ae36-7610f3caa4de tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleting attachment 8ffbe1e3-dbd8-4a06-903d-da1e037898f2. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:28:53 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info" returned: 0 in 0.691s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:53 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info is being set with open permissions: ugo+rw Jul 09 09:28:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:54 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info Jul 09 09:28:54 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:54 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.676s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:54 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3c277dd6-a6b1-465d-a5fc-2462a3b4a0cb tempest-GroupsTest-378071709 None] Delete group completed successfully. Jul 09 09:28:54 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.info" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.219s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1f9cbae5-817c-491f-b664-42b5ad7f47ff tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Create snapshot completed successfully Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-6b19e703-8f30-434a-bab4-2d709c752ac3-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-6b19e703-8f30-434a-bab4-2d709c752ac3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-quobyte-6b19e703-8f30-434a-bab4-2d709c752ac3" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-6b19e703-8f30-434a-bab4-2d709c752ac3" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7eaa9a-87dc-4df3-9b7f-a2ac053505ca]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:55 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 Jul 09 09:28:55 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "cinder-cf094645-30c2-4db2-aa60-d0555953327e-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-cf094645-30c2-4db2-aa60-d0555953327e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "cinder-quobyte-cf094645-30c2-4db2-aa60-d0555953327e" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-cf094645-30c2-4db2-aa60-d0555953327e" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Deleting offline snapshot cf094645-30c2-4db2-aa60-d0555953327e of volume 82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] snapshot_file for this snap is: volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a0f2f2-f013-4e7a-8662-70e63a0e7f14]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:56 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e Jul 09 09:28:56 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:56 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3" returned: 0 in 1.105s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:56 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3 Jul 09 09:28:56 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "cinder-3eba9c80-c909-45bd-ac7a-1d849152c71d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-3eba9c80-c909-45bd-ac7a-1d849152c71d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "cinder-quobyte-3eba9c80-c909-45bd-ac7a-1d849152c71d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-quobyte-3eba9c80-c909-45bd-ac7a-1d849152c71d" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d832d00-2b73-457c-ab2c-0deb486e4020]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:57 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e" returned: 0 in 1.349s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce76b82-df6c-493c-832d-c5acfd56898a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:57 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d Jul 09 09:28:57 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:57 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 Jul 09 09:28:57 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:57 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6b19e703-8f30-434a-bab4-2d709c752ac3" returned: 0 in 0.859s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-6b19e703-8f30-434a-bab4-2d709c752ac3" released by "delete_volume" :: held 2.033s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:57 devstack cinder-volume[87265]: WARNING cinder.quota [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139358164-1035570016 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139358164-1035570016, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:57 devstack cinder-volume[87265]: WARNING cinder.quota [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139358164-1035570016 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139358164-1035570016, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Created reservations ['6318e034-7b34-4366-b052-b3766359cf7f', '4f3f5318-a533-499c-91ad-c1d574991dce', '19ffd17d-1580-4dbd-8658-bf93be016fcd', '0203dd8f-e774-477e-b161-4a365e1269af'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:57 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:57 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:58 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d" returned: 0 in 1.154s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:58 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d Jul 09 09:28:58 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:58 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9" returned: 0 in 1.063s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:58 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e Jul 09 09:28:58 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:58 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.937s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:28:58 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleted volume successfully. Jul 09 09:28:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c5532e4c-6da1-43aa-8870-42810f24fcf9 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-6b19e703-8f30-434a-bab4-2d709c752ac3-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:59 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3eba9c80-c909-45bd-ac7a-1d849152c71d" returned: 0 in 0.791s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-quobyte-3eba9c80-c909-45bd-ac7a-1d849152c71d" released by "delete_volume" :: held 2.040s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Created reservations ['d1332618-61d1-481d-8244-79943844afc4', '5ccc6b51-c970-4ef5-92bf-0e98d5f3c194', '2cac4ca1-85c5-431d-b425-ca841401a195', 'ce91c0db-5cc8-4989-affa-a851dbffeb69'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:59 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:28:59 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:28:59 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e" returned: 0 in 1.040s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:28:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:28:59 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e Jul 09 09:28:59 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:00 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.736s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Deleted volume successfully. Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7399edd7-a99d-448e-92f5-aa8d4fd50093 tempest-GroupsV314Test-1805510217 None] Group tempest-GroupsV314Test-Group-1428050119: creating Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2c20b467-d516-46a3-aaa9-e1dac7fccd36 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-3eba9c80-c909-45bd-ac7a-1d849152c71d-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7399edd7-a99d-448e-92f5-aa8d4fd50093 tempest-GroupsV314Test-1805510217 None] Group tempest-GroupsV314Test-Group-1428050119: created successfully Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7399edd7-a99d-448e-92f5-aa8d4fd50093 tempest-GroupsV314Test-1805510217 None] Create group completed successfully. Jul 09 09:29:00 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9.cf094645-30c2-4db2-aa60-d0555953327e" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-cf094645-30c2-4db2-aa60-d0555953327e" released by "_delete_snapshot" :: held 4.308s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" released by "delete_snapshot" :: held 4.364s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Created reservations ['03c3aae8-1a7c-40b3-a24e-da0b45fb344a', '0ca9b09e-06a1-4d4e-8e50-51bebf18c801', '23b655ea-63e3-4b35-85ad-6f1c3163fc49', '372e9608-6420-4255-af7c-2cd170003bd6'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Delete snapshot completed successfully. Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ddce2c44-09c7-40a3-894d-026b6ad92380 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-cf094645-30c2-4db2-aa60-d0555953327e-delete_snapshot" released by "delete_snapshot" :: held 4.515s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "cinder-5d8ae354-4972-44ac-a876-6c73046073a3-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-5d8ae354-4972-44ac-a876-6c73046073a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "cinder-quobyte-5d8ae354-4972-44ac-a876-6c73046073a3" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-quobyte-5d8ae354-4972-44ac-a876-6c73046073a3" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc8b36-3770-478c-a001-7cf2aa951089]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:00 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 Jul 09 09:29:00 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-2dcd6999-4d2d-458b-aadf-03a43a1d42ce req-e9275429-9b0c-4616-9af4-ace89945f98b tempest-TestInstancesWithCinderVolumes-1799250398 None] Terminate volume connection completed successfully. Jul 09 09:29:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-2dcd6999-4d2d-458b-aadf-03a43a1d42ce req-e9275429-9b0c-4616-9af4-ace89945f98b tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleting attachment 85ef83b2-bf16-463f-92f7-afa517070323. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "cinder-82784de3-707a-42d1-81ab-4a1ea5b21eb9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-82784de3-707a-42d1-81ab-4a1ea5b21eb9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:01 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3" returned: 0 in 0.801s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:01 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3 Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:01 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923f6cd-8482-444d-ac7e-fc6139dda60d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:01 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 Jul 09 09:29:01 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Flow 'volume_create_manager' (c3981a1b-fbd3-4c75-81fe-299796518d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5201e3-3ca1-4eb9-b12d-d362fde04202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:02 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5201e3-3ca1-4eb9-b12d-d362fde04202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546789920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70e42d92-f077-4bdc-a0a7-8a1c2b9bdff8,host='devstack@QuobyteHD#QuobyteHD',id=e69ce1b8-86c1-48b7-8a83-2abd696512f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619f0f6fc824f41941e857bcbacc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:02Z,use_quota=True,user_id='a5bfc95de56845dd91511ff0c895c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cde78c6-a672-437a-bf56-93befbb57b54),volume_type_id=1cde78c6-a672-437a-bf56-93befbb57b54)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b7979-760d-4659-8017-0d22271d4f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b7979-760d-4659-8017-0d22271d4f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14214998-14a1-4410-bdca-2c97e392a29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14214998-14a1-4410-bdca-2c97e392a29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69ce1b8-86c1-48b7-8a83-2abd696512f8', 'volume_name': 'volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e971d8-bd65-491f-b18f-3bad548f3afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e971d8-bd65-491f-b18f-3bad548f3afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cca422-b780-484c-953b-64a64d80bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Volume e69ce1b8-86c1-48b7-8a83-2abd696512f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8', 'volume_size': 1} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70e42d92-f077-4bdc-a0a7-8a1c2b9bdff8,created_at=2026-07-09T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546789920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70e42d92-f077-4bdc-a0a7-8a1c2b9bdff8,host='devstack@QuobyteHD#QuobyteHD',id=e69ce1b8-86c1-48b7-8a83-2abd696512f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619f0f6fc824f41941e857bcbacc0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:02Z,use_quota=True,user_id='a5bfc95de56845dd91511ff0c895c5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cde78c6-a672-437a-bf56-93befbb57b54),volume_type_id=1cde78c6-a672-437a-bf56-93befbb57b54)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Creating volume e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:02 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-5d8ae354-4972-44ac-a876-6c73046073a3" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:02 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 1073741824 Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-quobyte-5d8ae354-4972-44ac-a876-6c73046073a3" released by "delete_volume" :: held 1.674s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:02 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Created reservations ['ee56c8fe-ea74-47e0-96ec-328949a6f871', 'ee01a29d-2b09-4624-a64f-909cd19e5d03', '7cd7a577-6138-4ee8-be77-a90bc8071096', 'efe003e9-9a43-42ff-a06d-a12a1970a4ce'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:02 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:02 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:02 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9" returned: 0 in 0.964s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:02 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9 Jul 09 09:29:02 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-38532dfb-54c9-4343-a1af-219acb1b07e6-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-38532dfb-54c9-4343-a1af-219acb1b07e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:03 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Deleted volume successfully. Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-quobyte-38532dfb-54c9-4343-a1af-219acb1b07e6" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bbd84ab4-e617-40ec-a800-4ae051bf2871 tempest-TestServerVolumeAttachmentScenario-173126986 None] Lock "cinder-5d8ae354-4972-44ac-a876-6c73046073a3-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-38532dfb-54c9-4343-a1af-219acb1b07e6" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:03 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-82784de3-707a-42d1-81ab-4a1ea5b21eb9" returned: 0 in 0.854s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af59c8-89a1-43d4-a855-5f5235a2da68]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:03 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-quobyte-82784de3-707a-42d1-81ab-4a1ea5b21eb9" released by "delete_volume" :: held 1.910s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 1073741824" returned: 0 in 1.132s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:03 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 Jul 09 09:29:03 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:03 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:03 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Created reservations ['1bd219eb-8f03-4b62-a88d-124c5effc341', '49a03ece-0ea4-49ef-b7dc-6d0bc69aa79d', 'ed35560e-ab23-437b-87ca-973fcebd1a67', 'f57d219d-61af-48ee-af72-a8bc6579d184'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:03 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:03 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:04 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 0.916s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cca422-b780-484c-953b-64a64d80bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea03498-5f9f-4ec2-985c-079ebabca68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:04 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Volume volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 (e69ce1b8-86c1-48b7-8a83-2abd696512f8): created successfully Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea03498-5f9f-4ec2-985c-079ebabca68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Flow 'volume_create_manager' (c3981a1b-fbd3-4c75-81fe-299796518d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ba7d721f-a14f-410d-a370-de5d1560fb8e tempest-GroupsV314Test-1805510217 None] Created volume successfully. Jul 09 09:29:04 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6" returned: 0 in 1.193s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:04 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6 Jul 09 09:29:04 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:04 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.147s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Deleted volume successfully. Jul 09 09:29:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a124cfef-3f3d-474d-941a-b1517ae915f4 tempest-VolumesSnapshotNegativeTestJSON-1777865341 None] Lock "cinder-82784de3-707a-42d1-81ab-4a1ea5b21eb9-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:05 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-38532dfb-54c9-4343-a1af-219acb1b07e6" returned: 0 in 1.005s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-38532dfb-54c9-4343-a1af-219acb1b07e6" released by "delete_volume" :: held 2.288s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:05 devstack cinder-volume[87265]: WARNING cinder.quota [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1042773122-1781184656 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1042773122-1781184656, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:05 devstack cinder-volume[87265]: WARNING cinder.quota [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1042773122-1781184656 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1042773122-1781184656, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Created reservations ['5a58886c-a205-4712-a3b0-c163335d7003', '893f29c8-c817-4990-8e66-f322519f7e8d', '059181e3-6136-4a23-a97b-180606817836', 'f9ecfb00-6c8d-4d6c-9277-079174462361'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:05 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:05 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:05 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Cloning volume e69ce1b8-86c1-48b7-8a83-2abd696512f8 to volume 1742dd46-7a11-4d41-ac00-a9927d375abf Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Creating offline snapshot 7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f of volume e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[60605c27-f2ca-44ce-bfa7-b45f6ff7f6ff]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:06 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:06 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:06 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.970s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:06 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleted volume successfully. Jul 09 09:29:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1a4a61b-c034-46fa-93d0-611b50effee4 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-38532dfb-54c9-4343-a1af-219acb1b07e6-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:07 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 1.146s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:07 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f 1G Jul 09 09:29:07 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:08 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f 1G" returned: 0 in 1.167s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:08 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:08 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:09 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 0.873s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:09 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:29:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:09 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:09 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:10 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 1.009s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:10 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info Jul 09 09:29:10 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:11 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info" returned: 0 in 0.855s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:11 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:11 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info Jul 09 09:29:11 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:11 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.info" returned: 0 in 0.768s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Acquiring lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] snapshot: 7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f, volume: 1742dd46-7a11-4d41-ac00-a9927d375abf, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43de6c-0157-4882-8ab7-358a97b97eca]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-ec2ca9d1-02c9-40a3-ad59-d6a5c54be21c req-0ab28746-edd9-40f1-8e0a-8a6639aef51c tempest-TestInstancesWithCinderVolumes-1799250398 None] Terminate volume connection completed successfully. Jul 09 09:29:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-ec2ca9d1-02c9-40a3-ad59-d6a5c54be21c req-0ab28746-edd9-40f1-8e0a-8a6639aef51c tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleting attachment d2ac6a75-4ba3-49a7-bfe8-7e74e2840d31. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:29:12 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:12 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:12 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 1.022s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[49418b3d-b1c9-471a-b1ee-f6f96486e30c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:13 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:13 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:13 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 0.985s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:13 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:29:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:13 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf Jul 09 09:29:13 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Flow 'volume_create_manager' (a68e0645-ddc2-4113-a1fa-e95ea6ef06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0445b814-6d38-441f-a665-a9322c4b28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0445b814-6d38-441f-a665-a9322c4b28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180e7c17-47ee-44bf-8ba7-6071535013e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddf84535e0b4de680454750ef10ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:14Z,use_quota=True,user_id='cd2e06d2cc83489583d7b7230894e7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80f27173-b9b2-40b8-bfc7-ff77a0802e46),volume_type_id=80f27173-b9b2-40b8-bfc7-ff77a0802e46)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c8823-31e5-4415-ac22-fe0aca613a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38c8823-31e5-4415-ac22-fe0aca613a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6e997b-2daf-4c65-8209-982018277864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6e997b-2daf-4c65-8209-982018277864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '180e7c17-47ee-44bf-8ba7-6071535013e9', 'volume_name': 'volume-180e7c17-47ee-44bf-8ba7-6071535013e9', 'volume_size': 1, 'image_id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fdd693bb72bb23492d5cf0dc405a7eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddf84535e0b4de680454750ef10ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '87d996a776790dd3ff9e6261216a94fec683c817dbf8a3796d123de8a628e5fcd1f2b1e48f81055921aecb554846291e39af4905dd1fe4f8842703f126b5febc', 'id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f041d8f1-0284-49dd-a00a-5515c6bee9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f041d8f1-0284-49dd-a00a-5515c6bee9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e769a3b3-23e5-41e2-95bd-381b8059997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Volume 180e7c17-47ee-44bf-8ba7-6071535013e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-180e7c17-47ee-44bf-8ba7-6071535013e9', 'volume_size': 1, 'image_id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fdd693bb72bb23492d5cf0dc405a7eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddf84535e0b4de680454750ef10ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '87d996a776790dd3ff9e6261216a94fec683c817dbf8a3796d123de8a628e5fcd1f2b1e48f81055921aecb554846291e39af4905dd1fe4f8842703f126b5febc', 'id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Trying to clone 180e7c17-47ee-44bf-8ba7-6071535013e9 from image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:29:14 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Image download 0.00 MB at 0.00 MB/s Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d380de-e6ab-44ef-be60-b8c7d683d6a0]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:15 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:15 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-06584ea0-a5f7-4054-8d59-31b0508924ee-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-06584ea0-a5f7-4054-8d59-31b0508924ee-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "cinder-quobyte-06584ea0-a5f7-4054-8d59-31b0508924ee" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-06584ea0-a5f7-4054-8d59-31b0508924ee" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969927c-c583-458d-b272-3d988fd1b8a8]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:16 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:29:16 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:16 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 0 in 2.067s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:17 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:17 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:18 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 1.984s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:18 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:29:18 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:19 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 1 in 2.295s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:19 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Temporary image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 is fetched for user cd2e06d2cc83489583d7b7230894e7ce. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:29:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba389a15-5885-4ab3-801e-3b5c3b1f1e47]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:19 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:19 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:20 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 1 in 1.888s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:20 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee Jul 09 09:29:20 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:20 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 0 in 1.182s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:20 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:20 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:20 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf" returned: 0 in 6.982s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353522b-e49b-4eb7-a5a3-99b5fd8a64f4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:21 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:21 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:21 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-06584ea0-a5f7-4054-8d59-31b0508924ee" returned: 0 in 1.138s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-quobyte-06584ea0-a5f7-4054-8d59-31b0508924ee" released by "delete_volume" :: held 5.196s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:21 devstack cinder-volume[87265]: WARNING cinder.quota [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472251930-1248720820 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472251930-1248720820, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:21 devstack cinder-volume[87265]: WARNING cinder.quota [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472251930-1248720820 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472251930-1248720820, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Created reservations ['b447e3ea-d17d-43b1-a303-09420f351343', 'e470fa1a-e106-4698-986a-06cfb83317f8', '17697059-e854-437c-8d0d-e0ba104dfbc3', '0b23bd29-0048-4277-af8d-85cd23a61cff'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:21 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:21 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:21 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 1 in 0.983s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (d6027824-7ba3-4e80-a486-dca29f64dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15819b5c-1e5c-488c-9934-6770d1dd3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15819b5c-1e5c-488c-9934-6770d1dd3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-784629474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef850df-0599-429c-8bc2-929f87fd530a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:22Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c988e29-a761-4377-a3d2-21cc443a5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c988e29-a761-4377-a3d2-21cc443a5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67823f7-7e7e-4ada-b550-a9af24f25e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67823f7-7e7e-4ada-b550-a9af24f25e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef850df-0599-429c-8bc2-929f87fd530a', 'volume_name': 'volume-9ef850df-0599-429c-8bc2-929f87fd530a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684fef7f-ee07-4287-9f0b-d69fa5383658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684fef7f-ee07-4287-9f0b-d69fa5383658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03638c85-a4ca-438e-9084-d6e3cce03526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume 9ef850df-0599-429c-8bc2-929f87fd530a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef850df-0599-429c-8bc2-929f87fd530a', 'volume_size': 1} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:21 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 1.029s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:29:21 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Converted 1024.00 MB image at 146.63 MB/s Jul 09 09:29:21 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf is being set with open permissions: ugo+rw: NotImplementedError Jul 09 09:29:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:22 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf Jul 09 09:29:22 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:22 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.701s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Deleted volume successfully. Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f16a0540-809e-4c36-ba15-127c40bb4c49 tempest-TestInstancesWithCinderVolumes-1799250398 None] Lock "cinder-06584ea0-a5f7-4054-8d59-31b0508924ee-delete_volume" released by "delete_volume" :: held 6.206s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:22 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf" returned: 0 in 0.648s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" released by "_copy_volume_from_snapshot" :: held 10.784s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Acquiring lock "cinder-quobyte-7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Deleting offline snapshot 7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f of volume e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] snapshot_file for this snap is: volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c8dd2-134e-43c7-b43d-832ec760a63f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:22 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:22 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:23 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 0.768s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:29:23 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a98a0-63f8-4a1c-87eb-582e42485b66]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:23 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:23 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:24 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 0.804s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:24 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:24 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:25 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 0.748s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:25 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f Jul 09 09:29:25 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:25 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8.7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-7253ae48-baa6-4b0c-bd8a-cc0b5ea9991f" released by "_delete_snapshot" :: held 3.151s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.983s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.271s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180e7c17-47ee-44bf-8ba7-6071535013e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddf84535e0b4de680454750ef10ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:14Z,use_quota=True,user_id='cd2e06d2cc83489583d7b7230894e7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80f27173-b9b2-40b8-bfc7-ff77a0802e46),volume_type_id=80f27173-b9b2-40b8-bfc7-ff77a0802e46)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Creating volume 180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:25 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:25 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1073741824 Jul 09 09:29:25 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-06180522-e838-43d3-b094-d9d95d48cdf7 tempest-GroupsV314Test-1805510217 None] Create group from source-group-70e42d92-f077-4bdc-a0a7-8a1c2b9bdff8 completed successfully. Jul 09 09:29:26 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1073741824" returned: 0 in 0.962s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:26 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:26 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Acquiring lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c493742-4677-46f9-af07-33522f11367f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:27 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf Jul 09 09:29:27 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:27 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 0 in 0.797s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.832s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-784629474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef850df-0599-429c-8bc2-929f87fd530a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:22Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume 9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:27 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:27 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a 1073741824 Jul 09 09:29:27 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Attempting download of 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}])) to volume 180e7c17-47ee-44bf-8ba7-6071535013e9. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4e725-cc92-4cca-9341-ade9357148d8]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:27 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q Jul 09 09:29:27 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:28 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf" returned: 0 in 0.958s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:28 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf Jul 09 09:29:28 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:28 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q" returned: 0 in 0.977s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:28 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a 1073741824" returned: 0 in 1.175s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:28 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q Jul 09 09:29:28 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a Jul 09 09:29:28 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:28 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:29 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1742dd46-7a11-4d41-ac00-a9927d375abf" returned: 0 in 0.923s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-1742dd46-7a11-4d41-ac00-a9927d375abf" released by "delete_volume" :: held 1.930s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Created reservations ['3449642e-8b98-4b06-b323-622d879b31c4'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:29 devstack cinder-volume[87265]: WARNING cinder.quota [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-887703474 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-887703474, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:29 devstack cinder-volume[87265]: WARNING cinder.quota [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-887703474 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-887703474, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Created reservations ['63cb0e77-1a85-4331-a08f-5300565deb3d', '3d90fede-755d-4731-b451-accbe078a6af', 'c18d586d-a937-4d43-b43f-da092d2b3e10', '87677c1f-6af2-4735-95cc-14dd26390c57'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:29 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:29 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:29 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a" returned: 0 in 0.855s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03638c85-a4ca-438e-9084-d6e3cce03526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef850df-0599-429c-8bc2-929f87fd530a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8efc9e-ff03-4f6f-bd98-e31bcf7f3cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:29 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-9ef850df-0599-429c-8bc2-929f87fd530a (9ef850df-0599-429c-8bc2-929f87fd530a): created successfully Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8efc9e-ff03-4f6f-bd98-e31bcf7f3cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (d6027824-7ba3-4e80-a486-dca29f64dd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b78da438-f9c6-41f8-a79e-4270036f1467 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:29 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q" returned: 1 in 1.154s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_fn4hh01q' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb00f1fe-dd6f-489f-809a-2af3fa9b08f9]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Acquiring lock "cinder-quobyte-e69ce1b8-86c1-48b7-8a83-2abd696512f8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-e69ce1b8-86c1-48b7-8a83-2abd696512f8" acquired by "delete_volume" :: waited 0.049s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0fc30-5822-4e6f-a825-2409ca31882c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:30 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:30 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:30 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:30 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:30 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.101s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-258d312e-3ebf-418d-8689-2d305d5d6ea2 tempest-GroupsV314Test-1805510217 None] Delete group completed successfully. Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating offline snapshot c3db7c2e-7e7d-4b4a-8068-d59bf488deca of volume 9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc22dd-a01e-425f-bc9f-ee1b83107ca4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:30 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a Jul 09 09:29:30 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:31 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:31 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD Jul 09 09:29:31 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:31 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 1.183s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:31 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8 Jul 09 09:29:31 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:31 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a" returned: 0 in 1.035s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:31 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca 1G Jul 09 09:29:31 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:31 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD" returned: 1 in 0.965s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 was raw, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:29:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:32 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:32 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:32 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e69ce1b8-86c1-48b7-8a83-2abd696512f8" returned: 0 in 0.825s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Lock "cinder-quobyte-e69ce1b8-86c1-48b7-8a83-2abd696512f8" released by "delete_volume" :: held 2.108s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Created reservations ['908a0f84-d48f-4453-b737-4df634e5f4df'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Created reservations ['85e5d95a-30e7-457f-a23e-5411cdc1a9e7', '3b1f21d9-a788-4786-9e7f-4fbaf1afd079', '5c458e79-f461-472e-bec2-0b3756207714', 'c46944d4-82ad-44e3-bfb1-047668f262a4'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:32 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:32 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:32 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca 1G" returned: 0 in 1.183s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef850df-0599-429c-8bc2-929f87fd530a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:32 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef850df-0599-429c-8bc2-929f87fd530a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca Jul 09 09:29:32 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:33 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 0 in 1.257s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fbe5c39-2d10-4a8b-9f86-f329dbc70369_oopmvtlzdevstack@QuobyteHD, size 0.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:29:33 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:33 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1G Jul 09 09:29:33 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:33 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.975s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7f48146d-d122-450f-a467-d8e5405e8c27 tempest-GroupsV314Test-1805510217 None] Delete group completed successfully. Jul 09 09:29:33 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef850df-0599-429c-8bc2-929f87fd530a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca" returned: 0 in 0.992s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:33 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca is being set with open permissions: ugo+rw Jul 09 09:29:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:33 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca Jul 09 09:29:33 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:34 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 1G" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e311f36b-5103-4cbd-9ed1-c7ac44497d8c]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:34 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:34 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:34 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca" returned: 0 in 0.979s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:34 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info Jul 09 09:29:34 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:35 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 0 in 0.945s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:35 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:35 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (64dcae71-03ca-40f8-89ef-98f0f2858a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128357ec-c119-4153-9c99-e1f8c93219e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128357ec-c119-4153-9c99-e1f8c93219e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989273350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ece798-972c-42a9-850e-489d0f2cf44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:35Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985c0137-8155-4bd6-a64c-58960306667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985c0137-8155-4bd6-a64c-58960306667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c241cb2-0c0a-4293-a54f-bff10e28dff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c241cb2-0c0a-4293-a54f-bff10e28dff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ece798-972c-42a9-850e-489d0f2cf44c', 'volume_name': 'volume-b1ece798-972c-42a9-850e-489d0f2cf44c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d174aa-f4fd-4922-aed2-200967388d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d174aa-f4fd-4922-aed2-200967388d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4538ba-4b89-4643-bab1-c152e815e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume b1ece798-972c-42a9-850e-489d0f2cf44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ece798-972c-42a9-850e-489d0f2cf44c', 'volume_size': 1} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:35 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info" returned: 0 in 0.821s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:35 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info is being set with open permissions: ugo+rw Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:35 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info Jul 09 09:29:35 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:35 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 1 in 0.904s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Downloaded image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 ((None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}])) to volume 180e7c17-47ee-44bf-8ba7-6071535013e9 successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Temporary image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 for user cd2e06d2cc83489583d7b7230894e7ce is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Marking volume 180e7c17-47ee-44bf-8ba7-6071535013e9 as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Copying metadata from image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 to 180e7c17-47ee-44bf-8ba7-6071535013e9. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:29:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Creating volume glance metadata for volume 180e7c17-47ee-44bf-8ba7-6071535013e9 backed by image 5fbe5c39-2d10-4a8b-9f86-f329dbc70369 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0fdd693bb72bb23492d5cf0dc405a7eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e769a3b3-23e5-41e2-95bd-381b8059997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180e7c17-47ee-44bf-8ba7-6071535013e9', 'volume_size': 1, 'image_id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fdd693bb72bb23492d5cf0dc405a7eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddf84535e0b4de680454750ef10ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '87d996a776790dd3ff9e6261216a94fec683c817dbf8a3796d123de8a628e5fcd1f2b1e48f81055921aecb554846291e39af4905dd1fe4f8842703f126b5febc', 'id': '5fbe5c39-2d10-4a8b-9f86-f329dbc70369', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fbe5c39-2d10-4a8b-9f86-f329dbc70369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f9254-fdcf-4a82-bf76-bd188b877b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:36 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Volume volume-180e7c17-47ee-44bf-8ba7-6071535013e9 (180e7c17-47ee-44bf-8ba7-6071535013e9): created successfully Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f9254-fdcf-4a82-bf76-bd188b877b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Flow 'volume_create_manager' (a68e0645-ddc2-4113-a1fa-e95ea6ef06fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-dcda281f-2e25-4825-861e-b12224ec727b tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Created volume successfully. Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Acquiring lock "cinder-180e7c17-47ee-44bf-8ba7-6071535013e9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "cinder-180e7c17-47ee-44bf-8ba7-6071535013e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Acquiring lock "cinder-quobyte-180e7c17-47ee-44bf-8ba7-6071535013e9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "cinder-quobyte-180e7c17-47ee-44bf-8ba7-6071535013e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8953b1-1512-4c4b-b9ec-e4cd1c22c962]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:36 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.info" returned: 0 in 0.821s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.948s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989273350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ece798-972c-42a9-850e-489d0f2cf44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:35Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume b1ece798-972c-42a9-850e-489d0f2cf44c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:36 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:36 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c 1073741824 Jul 09 09:29:36 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1004db9d-f0b1-478b-8f66-1305507e7802 tempest-CreateVolumesFromSnapshotTest-192032833 None] Create snapshot completed successfully Jul 09 09:29:36 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:36 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:37 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 0 in 0.898s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:37 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c 1073741824" returned: 0 in 1.025s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (5291edf5-50d6-4380-9550-538fba1ffb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98268d3-9bcd-42ee-aed0-7353335a4563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:37 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:37 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98268d3-9bcd-42ee-aed0-7353335a4563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799438040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feff8972-f5a5-4d43-935b-a4aea5c02608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41cf935-1b32-49d2-870b-9f2b16179818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41cf935-1b32-49d2-870b-9f2b16179818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2af187b-aa92-4583-a714-5cf77a93254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2af187b-aa92-4583-a714-5cf77a93254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feff8972-f5a5-4d43-935b-a4aea5c02608', 'volume_name': 'volume-feff8972-f5a5-4d43-935b-a4aea5c02608', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50611aa3-d7e4-4ece-b5e1-5aac8eb8fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50611aa3-d7e4-4ece-b5e1-5aac8eb8fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474ec3fa-df03-4714-8083-c20cf132400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume feff8972-f5a5-4d43-935b-a4aea5c02608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feff8972-f5a5-4d43-935b-a4aea5c02608', 'volume_size': 1} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:37 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c Jul 09 09:29:37 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (99443173-b488-4dad-95f9-6ed6cfdcf10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037985c-1732-4e59-af56-58f3a07ee8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037985c-1732-4e59-af56-58f3a07ee8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658044777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c07ec7-441f-4424-a3a5-c261a528b6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29271bf4-d608-474b-9c3e-5e47d8c9a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29271bf4-d608-474b-9c3e-5e47d8c9a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25559153-f32a-4bc8-ab5c-518ad86a7f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25559153-f32a-4bc8-ab5c-518ad86a7f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c07ec7-441f-4424-a3a5-c261a528b6c2', 'volume_name': 'volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510d4aa-1c43-4ff0-9936-30bba6418a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510d4aa-1c43-4ff0-9936-30bba6418a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9c789a-5a94-4370-bb9e-d51f503ac46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume e4c07ec7-441f-4424-a3a5-c261a528b6c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2', 'volume_size': 1} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (dab0559d-2b1b-4f87-a698-5fc36abb7ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73b392d-fab7-44ff-a5f6-8d28392a5930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73b392d-fab7-44ff-a5f6-8d28392a5930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889706318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47286048-55b1-4073-b73d-715ff5cf897d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c16c6a-bb17-4047-b222-d05ac3ead445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c16c6a-bb17-4047-b222-d05ac3ead445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391d4a1b-be5d-4fe5-8852-3fc97f273e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391d4a1b-be5d-4fe5-8852-3fc97f273e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47286048-55b1-4073-b73d-715ff5cf897d', 'volume_name': 'volume-47286048-55b1-4073-b73d-715ff5cf897d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524003d-10d5-45a9-af7c-1ac551a8d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524003d-10d5-45a9-af7c-1ac551a8d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae375dc-f4b5-4856-8dcd-bb32ea083888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume 47286048-55b1-4073-b73d-715ff5cf897d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47286048-55b1-4073-b73d-715ff5cf897d', 'volume_size': 1} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:38 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 1 in 1.168s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:38 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9 Jul 09 09:29:38 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:38 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c" returned: 0 in 1.059s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799438040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feff8972-f5a5-4d43-935b-a4aea5c02608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume feff8972-f5a5-4d43-935b-a4aea5c02608 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:38 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4538ba-4b89-4643-bab1-c152e815e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ece798-972c-42a9-850e-489d0f2cf44c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 1073741824 Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debff11c-49be-401d-83d3-9c203d9392bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:38 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-b1ece798-972c-42a9-850e-489d0f2cf44c (b1ece798-972c-42a9-850e-489d0f2cf44c): created successfully Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debff11c-49be-401d-83d3-9c203d9392bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (64dcae71-03ca-40f8-89ef-98f0f2858a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cbc10bcd-9ab2-4290-afe5-137f4d4579b9 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (70de6c41-3292-4053-8c63-c8e8e1d377b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d286d392-dcb3-4530-bdb2-a5aaaf6cc0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d286d392-dcb3-4530-bdb2-a5aaaf6cc0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766837127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0746798-b6b1-4a5d-ac22-515dbcd757af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:39Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1234f7d3-1613-4296-8ab7-f8b891078f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1234f7d3-1613-4296-8ab7-f8b891078f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f92fd02-113c-4a90-8209-78b65d0d18af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f92fd02-113c-4a90-8209-78b65d0d18af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0746798-b6b1-4a5d-ac22-515dbcd757af', 'volume_name': 'volume-b0746798-b6b1-4a5d-ac22-515dbcd757af', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a428479-2682-405a-9ba0-7cc4b69f6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a428479-2682-405a-9ba0-7cc4b69f6973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd61fec1-a6da-4e51-93e7-18a7ca7971ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume b0746798-b6b1-4a5d-ac22-515dbcd757af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0746798-b6b1-4a5d-ac22-515dbcd757af', 'volume_size': 1} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:39 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-180e7c17-47ee-44bf-8ba7-6071535013e9" returned: 0 in 0.913s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "cinder-quobyte-180e7c17-47ee-44bf-8ba7-6071535013e9" released by "delete_volume" :: held 3.055s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (59a3e0b9-c10d-4d64-bb95-7b21e4358a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f08d550-394b-4ded-b3c9-af371a93b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-76b42c0f-4684-4e85-ac6c-2447c232418b tempest-GroupsV320Test-1858139211 None] Group tempest-GroupsV320Test-Group-1270680207: creating Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f08d550-394b-4ded-b3c9-af371a93b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835073490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf95db6-91ab-479d-a994-8f7fa891c800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:40Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e04039-7eb1-472c-9cc6-b56cf2dece7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e04039-7eb1-472c-9cc6-b56cf2dece7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c5e543-de54-4e43-a82a-0cab7ed24a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c5e543-de54-4e43-a82a-0cab7ed24a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf95db6-91ab-479d-a994-8f7fa891c800', 'volume_name': 'volume-1cf95db6-91ab-479d-a994-8f7fa891c800', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f2dbba-fda5-4986-8ff2-8c15e2376573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f2dbba-fda5-4986-8ff2-8c15e2376573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72b661-bfae-4038-af50-a423f6b040f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume 1cf95db6-91ab-479d-a994-8f7fa891c800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf95db6-91ab-479d-a994-8f7fa891c800', 'volume_size': 1} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:39 devstack cinder-volume[87265]: WARNING cinder.quota [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:39 devstack cinder-volume[87265]: WARNING cinder.quota [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Created reservations ['8c029df2-5957-4e7c-ad0f-c6fe50c3a02c', '5382ad33-2e92-4b3d-8d19-d9ab731979bd', '1d1a31a5-a4a2-48da-b7a4-bafdff6fba82', '796244a3-63ec-413b-b526-b9f2ca519c01'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-76b42c0f-4684-4e85-ac6c-2447c232418b tempest-GroupsV320Test-1858139211 None] Group tempest-GroupsV320Test-Group-1270680207: created successfully Jul 09 09:29:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-76b42c0f-4684-4e85-ac6c-2447c232418b tempest-GroupsV320Test-1858139211 None] Create group completed successfully. Jul 09 09:29:39 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 1073741824" returned: 0 in 0.988s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:39 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:39 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:39 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 Jul 09 09:29:39 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (1c908d09-9e38-456b-a3b6-45aa7ce8db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bb00ff-abaf-4200-b5d6-6a5d7a755e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=129,cinder:INSERT=38,cinder:UPDATE=147,cinder:DELETE=5 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bb00ff-abaf-4200-b5d6-6a5d7a755e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469938014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760df3f9-1c41-4ddd-b7cd-0c7d3e64171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:40Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5761aad-40f4-4eee-91a9-7a35e4b3bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5761aad-40f4-4eee-91a9-7a35e4b3bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c0cfb5-474f-45a5-8ab2-3b86c0f4905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c0cfb5-474f-45a5-8ab2-3b86c0f4905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760df3f9-1c41-4ddd-b7cd-0c7d3e64171c', 'volume_name': 'volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded01497-8177-48c7-809b-063ebf18cfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded01497-8177-48c7-809b-063ebf18cfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e827e7c7-d9ab-4ec5-a091-7eb6e5e2009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume 760df3f9-1c41-4ddd-b7cd-0c7d3e64171c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c', 'volume_size': 1} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608" returned: 0 in 0.897s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658044777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c07ec7-441f-4424-a3a5-c261a528b6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume e4c07ec7-441f-4424-a3a5-c261a528b6c2 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:40 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=135,cinder:INSERT=39,cinder:UPDATE=148,cinder:DELETE=11 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474ec3fa-df03-4714-8083-c20cf132400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feff8972-f5a5-4d43-935b-a4aea5c02608', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:40 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 1073741824 Jul 09 09:29:40 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f613c-f4e9-4fd8-b8f3-47150e8c4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.027s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-feff8972-f5a5-4d43-935b-a4aea5c02608 (feff8972-f5a5-4d43-935b-a4aea5c02608): created successfully Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f613c-f4e9-4fd8-b8f3-47150e8c4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (5291edf5-50d6-4380-9550-538fba1ffb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Deleted volume successfully. Jul 09 09:29:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6c43dbbc-8843-45c7-b505-06d67a9b38c6 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d7a489d9-ffdc-4e55-a62c-4b0386cb27dd tempest-VolumeAndVolumeTypeFromImageTest-197070309 None] Lock "cinder-180e7c17-47ee-44bf-8ba7-6071535013e9-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (b77529ee-5170-4a44-9f99-977826463f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16757ff0-dfe4-4409-bf67-4b7eb605f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16757ff0-dfe4-4409-bf67-4b7eb605f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402776504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89970d3c-715b-44cf-9fd8-ecb2d2e4710b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:41Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d235e0ce-56fa-47c4-adea-557fb879565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d235e0ce-56fa-47c4-adea-557fb879565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e16610c-b6dc-411f-81e3-933b4b209dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e16610c-b6dc-411f-81e3-933b4b209dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89970d3c-715b-44cf-9fd8-ecb2d2e4710b', 'volume_name': 'volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70364d74-853b-4175-b8f3-449eda97c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70364d74-853b-4175-b8f3-449eda97c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5673fed-b021-4919-bac5-086bbe685e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume 89970d3c-715b-44cf-9fd8-ecb2d2e4710b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b', 'volume_size': 1} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Created reservations ['ac361ab3-6cb6-42af-bd3c-827d34995eb5'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (be2db4c7-7fc4-406d-ba94-60d9f4047669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b7ec3-8357-4041-bd02-6c34e59e05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b7ec3-8357-4041-bd02-6c34e59e05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009083681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96fddbf-200d-4b8a-a4cc-783a7ab3abc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:41Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f613cd5a-eec9-44aa-9b8b-5fc038ccb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f613cd5a-eec9-44aa-9b8b-5fc038ccb946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5dcd21-3b2e-48a2-bfe8-2ed5e2d4f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5dcd21-3b2e-48a2-bfe8-2ed5e2d4f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96fddbf-200d-4b8a-a4cc-783a7ab3abc7', 'volume_name': 'volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951883c1-d65e-4884-b7c3-8bf4b20829f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951883c1-d65e-4884-b7c3-8bf4b20829f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6f48d-d335-44f9-a7aa-4ea64a124a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:41 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume b96fddbf-200d-4b8a-a4cc-783a7ab3abc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7', 'volume_size': 1} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:41 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:41 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (21dbd1d9-5af9-4ec0-aef7-6b53cac94e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b802b5-b6f8-4aa0-829d-ea10b8c3cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b802b5-b6f8-4aa0-829d-ea10b8c3cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-779277603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ae69d-ca24-4f70-8452-151a5033e0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:42Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fd8979-7cda-4035-94eb-c62279a5e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fd8979-7cda-4035-94eb-c62279a5e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79facf13-e1f8-4c52-a9ad-9284f89b4442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79facf13-e1f8-4c52-a9ad-9284f89b4442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00ae69d-ca24-4f70-8452-151a5033e0e5', 'volume_name': 'volume-f00ae69d-ca24-4f70-8452-151a5033e0e5', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6c734-a57c-447f-832b-001c031e4bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6c734-a57c-447f-832b-001c031e4bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a007df-3d67-43d5-9461-195c1cd621d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume f00ae69d-ca24-4f70-8452-151a5033e0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00ae69d-ca24-4f70-8452-151a5033e0e5', 'volume_size': 1} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:42 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 1073741824" returned: 0 in 1.381s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:42 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 Jul 09 09:29:42 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (00a2f91e-3087-424a-bdcc-209c550ad7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:42 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d652f396-ed8c-4739-b989-8747b0a43e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.847s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d652f396-ed8c-4739-b989-8747b0a43e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588061368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6002422-80e3-456f-aeb5-6c84219d4822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:42Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822e6339-abe5-4afa-a58b-7d641f53231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822e6339-abe5-4afa-a58b-7d641f53231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca957f69-4ee2-4b20-948a-1b79b29c0da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca957f69-4ee2-4b20-948a-1b79b29c0da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6002422-80e3-456f-aeb5-6c84219d4822', 'volume_name': 'volume-a6002422-80e3-456f-aeb5-6c84219d4822', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9abc258-7080-4f95-9dfe-785621b7312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9abc258-7080-4f95-9dfe-785621b7312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0183df64-852b-4fa6-8176-2aa5941564fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume a6002422-80e3-456f-aeb5-6c84219d4822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6002422-80e3-456f-aeb5-6c84219d4822', 'volume_size': 1} Jul 09 09:29:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a33c5080-89b2-4740-826b-7afa376432d8 tempest-GroupsV320Test-1858139211 None] Delete group completed successfully. Jul 09 09:29:43 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2" returned: 0 in 0.796s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.553s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889706318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47286048-55b1-4073-b73d-715ff5cf897d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:38Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume 47286048-55b1-4073-b73d-715ff5cf897d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:43 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:43 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d 1073741824 Jul 09 09:29:43 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9c789a-5a94-4370-bb9e-d51f503ac46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ab3916-cd78-4dd3-b086-56e5bec26df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:43 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 (e4c07ec7-441f-4424-a3a5-c261a528b6c2): created successfully Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ab3916-cd78-4dd3-b086-56e5bec26df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (99443173-b488-4dad-95f9-6ed6cfdcf10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9eba0805-c249-450c-9b7e-0a58505f6893 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:44 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d 1073741824" returned: 0 in 1.055s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:44 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d Jul 09 09:29:44 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:44 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d" returned: 0 in 0.725s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.776s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766837127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0746798-b6b1-4a5d-ac22-515dbcd757af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:39Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume b0746798-b6b1-4a5d-ac22-515dbcd757af {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:44 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:44 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af 1073741824 Jul 09 09:29:44 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae375dc-f4b5-4856-8dcd-bb32ea083888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47286048-55b1-4073-b73d-715ff5cf897d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0903c227-5481-4d49-b6d1-0f537c2a847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:45 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-47286048-55b1-4073-b73d-715ff5cf897d (47286048-55b1-4073-b73d-715ff5cf897d): created successfully Jul 09 09:29:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0903c227-5481-4d49-b6d1-0f537c2a847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (dab0559d-2b1b-4f87-a698-5fc36abb7ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9ee59f52-9c02-40c2-aaaf-53030e2b8c48 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:45 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af 1073741824" returned: 0 in 0.935s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:45 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af Jul 09 09:29:45 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:46 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af" returned: 0 in 0.674s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.847s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835073490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf95db6-91ab-479d-a994-8f7fa891c800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacc2c61aae14248b15f93ff5789b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:40Z,use_quota=True,user_id='3683c45b64114d1b9fa415569668a618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Creating volume 1cf95db6-91ab-479d-a994-8f7fa891c800 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:46 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd61fec1-a6da-4e51-93e7-18a7ca7971ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0746798-b6b1-4a5d-ac22-515dbcd757af', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9956bd9b-da28-4652-b195-39586810476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:46 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 1073741824 Jul 09 09:29:46 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-b0746798-b6b1-4a5d-ac22-515dbcd757af (b0746798-b6b1-4a5d-ac22-515dbcd757af): created successfully Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9956bd9b-da28-4652-b195-39586810476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (70de6c41-3292-4053-8c63-c8e8e1d377b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0ebcd6ff-f146-4579-bd2d-d6af7a0b8545 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:47 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 1073741824" returned: 0 in 0.978s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:47 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 Jul 09 09:29:47 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:48 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.521s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469938014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760df3f9-1c41-4ddd-b7cd-0c7d3e64171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:40Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume 760df3f9-1c41-4ddd-b7cd-0c7d3e64171c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72b661-bfae-4038-af50-a423f6b040f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf95db6-91ab-479d-a994-8f7fa891c800', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:48 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c 1073741824 Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5369c0fb-b3f0-454a-9d00-a8cbaa519098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:48 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Volume volume-1cf95db6-91ab-479d-a994-8f7fa891c800 (1cf95db6-91ab-479d-a994-8f7fa891c800): created successfully Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5369c0fb-b3f0-454a-9d00-a8cbaa519098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Flow 'volume_create_manager' (59a3e0b9-c10d-4d64-bb95-7b21e4358a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-18c2cd3b-c789-4e1a-9f71-72b1bfe6e6ec tempest-CreateVolumesFromSnapshotTest-192032833 None] Created volume successfully. Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Flow 'volume_create_manager' (75fc3a68-83ee-4b3f-8659-5bb351a3840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af7472-bb9e-4af0-99e0-4536181b1599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af7472-bb9e-4af0-99e0-4536181b1599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad78c63-90a0-48fb-8c6d-fe279ff0edfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f507fee205431398e2f9a0953e742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:49Z,use_quota=True,user_id='1dd682b0718b4314989afefb2ec19570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c013a0ac-f62a-4293-820d-06f81fdd86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c013a0ac-f62a-4293-820d-06f81fdd86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903a9fd9-f340-41f3-89be-84c1bc5b9443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:48 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903a9fd9-f340-41f3-89be-84c1bc5b9443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dad78c63-90a0-48fb-8c6d-fe279ff0edfd', 'volume_name': 'volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd', 'volume_size': 1, 'image_id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb1d78569158dc03a8bde881bc93097c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f507fee205431398e2f9a0953e742e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca04c622054e26c66a439c78f10a0861f659b998f17b1846c96ad8b297ae5eb36e24d47b88a9fad4dcaa2a397ba7a691eddb0a906e70cffc3c807b057636cb1', 'id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e494d9a9-1a6f-413d-9cbe-013ca1707940/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a3d4b7-46f3-4706-8502-2c4dc20c5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a3d4b7-46f3-4706-8502-2c4dc20c5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b7d43-2d8b-4ea2-83cb-dab7530f8013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd', 'volume_size': 1, 'image_id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb1d78569158dc03a8bde881bc93097c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f507fee205431398e2f9a0953e742e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca04c622054e26c66a439c78f10a0861f659b998f17b1846c96ad8b297ae5eb36e24d47b88a9fad4dcaa2a397ba7a691eddb0a906e70cffc3c807b057636cb1', 'id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e494d9a9-1a6f-413d-9cbe-013ca1707940/file', 'properties': {}}, 'image_service': } Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Trying to clone dad78c63-90a0-48fb-8c6d-fe279ff0edfd from image e494d9a9-1a6f-413d-9cbe-013ca1707940 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:29:49 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Image download 0.00 MB at 0.00 MB/s Jul 09 09:29:49 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c 1073741824" returned: 0 in 1.001s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa42e1e3-8cfc-425c-8169-4cb604d79764]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:49 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c Jul 09 09:29:49 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:49 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:29:49 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-1cf95db6-91ab-479d-a994-8f7fa891c800-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-1cf95db6-91ab-479d-a994-8f7fa891c800-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-1cf95db6-91ab-479d-a994-8f7fa891c800" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-1cf95db6-91ab-479d-a994-8f7fa891c800" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d292bfb-49bd-46c6-9002-afc61b136851]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:49 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 Jul 09 09:29:49 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:50 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" returned: 0 in 0.789s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.940s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402776504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89970d3c-715b-44cf-9fd8-ecb2d2e4710b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:41Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume 89970d3c-715b-44cf-9fd8-ecb2d2e4710b {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:50 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:50 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b 1073741824 Jul 09 09:29:50 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e827e7c7-d9ab-4ec5-a091-7eb6e5e2009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4b035-0108-44c5-9e21-8a1c7b409761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c (760df3f9-1c41-4ddd-b7cd-0c7d3e64171c): created successfully Jul 09 09:29:50 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4b035-0108-44c5-9e21-8a1c7b409761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (1c908d09-9e38-456b-a3b6-45aa7ce8db86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 0 in 0.895s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6e66dd91-1bff-429a-89ad-bb743de189c4 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:50 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:29:50 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:50 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:50 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:50 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800" returned: 0 in 1.095s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:50 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800 Jul 09 09:29:50 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:51 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b 1073741824" returned: 0 in 1.119s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:51 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 1 in 1.036s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Temporary image e494d9a9-1a6f-413d-9cbe-013ca1707940 is fetched for user 1dd682b0718b4314989afefb2ec19570. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:51 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b Jul 09 09:29:51 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5840ae2-e39e-4c19-a1d9-3d40c48c077b]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:51 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.963s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 28 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:29:51 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:29:51 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:51 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-1cf95db6-91ab-479d-a994-8f7fa891c800" returned: 0 in 0.929s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-1cf95db6-91ab-479d-a994-8f7fa891c800" released by "delete_volume" :: held 2.110s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['100aa173-55a4-4a88-880a-c2239f268f5b', 'b733ad22-5d05-413d-ba52-36d7cbb8272f', '07d0147a-3751-4cb0-a1a2-5ef27bbb4abb', '9661176e-e1c9-46c9-8a3e-32930f454cf0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:52 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:52 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:52 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" returned: 0 in 0.723s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.398s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009083681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96fddbf-200d-4b8a-a4cc-783a7ab3abc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:41Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:52 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:52 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 1073741824 Jul 09 09:29:52 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5673fed-b021-4919-bac5-086bbe685e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf73875-0040-4d28-9df3-e5664face525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b (89970d3c-715b-44cf-9fd8-ecb2d2e4710b): created successfully Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf73875-0040-4d28-9df3-e5664face525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (b77529ee-5170-4a44-9f99-977826463f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-36534e88-e4d8-482a-a421-b7e3512cce25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:52 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 0 in 0.947s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:52 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:29:52 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:52 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.780s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:29:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b9c958ac-646e-445f-81be-4d5239936c3b tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-1cf95db6-91ab-479d-a994-8f7fa891c800-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-b0746798-b6b1-4a5d-ac22-515dbcd757af-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:53 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 1073741824" returned: 0 in 0.978s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-b0746798-b6b1-4a5d-ac22-515dbcd757af-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:53 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-b0746798-b6b1-4a5d-ac22-515dbcd757af" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:53 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-b0746798-b6b1-4a5d-ac22-515dbcd757af" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f8a86c-5c87-4cb6-a45b-e61a4855c678]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:53 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 1 in 0.958s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:53 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af Jul 09 09:29:53 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:53 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" returned: 0 in 0.707s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.729s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-779277603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ae69d-ca24-4f70-8452-151a5033e0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:42Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume f00ae69d-ca24-4f70-8452-151a5033e0e5 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:53 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6f48d-d335-44f9-a7aa-4ea64a124a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8a099e-7c71-44c1-8c1a-153ff6e2ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:53 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 1073741824 Jul 09 09:29:53 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:53 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 (b96fddbf-200d-4b8a-a4cc-783a7ab3abc7): created successfully Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8a099e-7c71-44c1-8c1a-153ff6e2ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:53 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (be2db4c7-7fc4-406d-ba94-60d9f4047669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-27f8221c-fbad-4787-9d2b-d76c1487717e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:54 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af" returned: 0 in 0.865s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:54 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af Jul 09 09:29:54 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:54 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0746798-b6b1-4a5d-ac22-515dbcd757af" returned: 0 in 0.696s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-b0746798-b6b1-4a5d-ac22-515dbcd757af" released by "delete_volume" :: held 1.625s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:54 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 1073741824" returned: 0 in 0.960s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Flow 'volume_create_manager' (4e89084e-2328-47b0-9175-c88f81f73b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770064f3-d4e1-4095-a2f8-5d79df81d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770064f3-d4e1-4095-a2f8-5d79df81d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1976116056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adeeac8-2f1e-4201-afcd-e7f2f0d7b524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9ccfc220e948f9a216022a718bd5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:55Z,use_quota=True,user_id='7e1945e7f9ed4670a9fd5f18055ed474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(055b86dc-beb0-4770-afb6-4df476b740d7),volume_type_id=055b86dc-beb0-4770-afb6-4df476b740d7)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff2eeea-a2fd-44bc-9722-3639446be044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff2eeea-a2fd-44bc-9722-3639446be044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e24af-564f-4325-933c-f38391b52b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e24af-564f-4325-933c-f38391b52b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8adeeac8-2f1e-4201-afcd-e7f2f0d7b524', 'volume_name': 'volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacf1325-18c4-4e8c-9c7b-343b16a107d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacf1325-18c4-4e8c-9c7b-343b16a107d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18447f66-1fbc-4b06-9d6e-4fbd710b4c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Volume 8adeeac8-2f1e-4201-afcd-e7f2f0d7b524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524', 'volume_size': 1} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:54 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 Jul 09 09:29:54 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:54 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['fc8d6c4a-2af3-4bb7-804a-112ee6b0e73d', '2957d746-fcce-449d-b8af-94f5a52ceeeb', '2d352ce2-8239-48dc-91b4-91b816af83e0', '737c4571-700d-43b1-a7be-9a8bafda4368'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:55 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:55 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-47286048-55b1-4073-b73d-715ff5cf897d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-47286048-55b1-4073-b73d-715ff5cf897d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-47286048-55b1-4073-b73d-715ff5cf897d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-47286048-55b1-4073-b73d-715ff5cf897d" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d326924-67bf-4a54-a296-554c3bb23a0a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:55 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d Jul 09 09:29:55 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:55 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5" returned: 0 in 0.663s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.944s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588061368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6002422-80e3-456f-aeb5-6c84219d4822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb159d454d31a4092d65027a8810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:42Z,use_quota=True,user_id='342a0a87efd840cb9c400b6b3263557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Creating volume a6002422-80e3-456f-aeb5-6c84219d4822 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:55 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a007df-3d67-43d5-9461-195c1cd621d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00ae69d-ca24-4f70-8452-151a5033e0e5', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:55 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 1073741824 Jul 09 09:29:55 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bf8d80-707b-4162-bd9d-a483f9ca357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 (f00ae69d-ca24-4f70-8452-151a5033e0e5): created successfully Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bf8d80-707b-4162-bd9d-a483f9ca357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (21dbd1d9-5af9-4ec0-aef7-6b53cac94e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-657fbdbb-dc46-47b8-b5d6-cf98b1813501 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:55 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:29:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-02d21774-1b73-4ac9-bed9-3034cf6de328 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-b0746798-b6b1-4a5d-ac22-515dbcd757af-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:56 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d" returned: 0 in 0.813s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:56 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d Jul 09 09:29:56 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:56 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 1073741824" returned: 0 in 0.881s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:56 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 Jul 09 09:29:56 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:56 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-47286048-55b1-4073-b73d-715ff5cf897d" returned: 0 in 0.672s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-47286048-55b1-4073-b73d-715ff5cf897d" released by "delete_volume" :: held 1.520s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:56 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['cce9182d-9c51-4822-8cfd-fd649845575a', 'de38f454-13db-4056-bb80-c2cde44dc5a5', 'e3cf6cf1-f1f2-44a0-9abf-8b6cf407d7af', '097bd65d-73ef-4d45-be58-e1d66c906bfa'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:57 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:57 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:57 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad78c63-90a0-48fb-8c6d-fe279ff0edfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f507fee205431398e2f9a0953e742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:49Z,use_quota=True,user_id='1dd682b0718b4314989afefb2ec19570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Creating volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:57 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:57 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1073741824 Jul 09 09:29:57 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0183df64-852b-4fa6-8176-2aa5941564fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6002422-80e3-456f-aeb5-6c84219d4822', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fd447e-2cac-43b3-b97b-53590eaa55f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:29:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Volume volume-a6002422-80e3-456f-aeb5-6c84219d4822 (a6002422-80e3-456f-aeb5-6c84219d4822): created successfully Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fd447e-2cac-43b3-b97b-53590eaa55f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Flow 'volume_create_manager' (00a2f91e-3087-424a-bdcc-209c550ad7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:29:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9baa6e55-7458-47a7-9a17-5e65ba10bf25 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created volume successfully. Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-e4c07ec7-441f-4424-a3a5-c261a528b6c2-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-e4c07ec7-441f-4424-a3a5-c261a528b6c2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-e4c07ec7-441f-4424-a3a5-c261a528b6c2" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-e4c07ec7-441f-4424-a3a5-c261a528b6c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[16294e89-8ddb-46d6-a82b-61a5e3a9c7ce]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:57 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:29:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-01e02362-72b3-47a0-8133-09789cb149c9 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-47286048-55b1-4073-b73d-715ff5cf897d-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:57 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 Jul 09 09:29:57 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-a6002422-80e3-456f-aeb5-6c84219d4822-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-a6002422-80e3-456f-aeb5-6c84219d4822-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-a6002422-80e3-456f-aeb5-6c84219d4822" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-a6002422-80e3-456f-aeb5-6c84219d4822" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b1c34-065c-46d8-8845-d653c284854e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:58 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1073741824" returned: 0 in 0.923s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:58 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 Jul 09 09:29:58 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:58 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:29:58 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:58 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2" returned: 0 in 0.890s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:58 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2 Jul 09 09:29:58 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:58 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822" returned: 0 in 0.832s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:58 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822 Jul 09 09:29:58 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:58 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 0 in 0.739s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.992s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1976116056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adeeac8-2f1e-4201-afcd-e7f2f0d7b524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9ccfc220e948f9a216022a718bd5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:29:55Z,use_quota=True,user_id='7e1945e7f9ed4670a9fd5f18055ed474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(055b86dc-beb0-4770-afb6-4df476b740d7),volume_type_id=055b86dc-beb0-4770-afb6-4df476b740d7)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Creating volume 8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:29:58 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:29:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:58 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 1073741824 Jul 09 09:29:58 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Attempting download of e494d9a9-1a6f-413d-9cbe-013ca1707940 ((None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}])) to volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9f6843-5d35-4560-8a78-4fcf845b0132]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:59 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7 Jul 09 09:29:59 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:59 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4c07ec7-441f-4424-a3a5-c261a528b6c2" returned: 0 in 0.709s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-e4c07ec7-441f-4424-a3a5-c261a528b6c2" released by "delete_volume" :: held 1.648s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['5eb86bc0-d11d-4b31-93e1-fb4f3f6c8e36', '2fa6cb35-27ed-4f60-baf5-ee779647ec3b', '25ff7e40-ee97-43bb-8b0a-288cafcda974', '47d1d333-169e-493a-ba73-6b94e6363482'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:59 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:59 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:59 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a6002422-80e3-456f-aeb5-6c84219d4822" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-a6002422-80e3-456f-aeb5-6c84219d4822" released by "delete_volume" :: held 1.629s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['3d5cde85-06f2-45b1-a9c6-ee786930e3b5', 'f116c8e6-eda7-4d43-a9ba-2c50e58ca6c2', '32439d08-3d98-4b66-a455-2301481cea6b', 'a56c5abe-42d9-4ee7-ba97-e95b53a3417d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:29:59 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:29:59 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-feff8972-f5a5-4d43-935b-a4aea5c02608-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-feff8972-f5a5-4d43-935b-a4aea5c02608-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:29:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-feff8972-f5a5-4d43-935b-a4aea5c02608" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-feff8972-f5a5-4d43-935b-a4aea5c02608" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a17c0-47d1-4ca3-9101-248203e406a9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:00 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 Jul 09 09:30:00 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:00 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:00 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-f00ae69d-ca24-4f70-8452-151a5033e0e5-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7" returned: 0 in 1.121s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 1073741824" returned: 0 in 1.294s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:00 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.839s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-f00ae69d-ca24-4f70-8452-151a5033e0e5-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b67f62a-fb2a-4d2e-a61a-d563eab0cd11 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-e4c07ec7-441f-4424-a3a5-c261a528b6c2-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-f00ae69d-ca24-4f70-8452-151a5033e0e5" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:00 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7 Jul 09 09:30:00 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:00 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-f00ae69d-ca24-4f70-8452-151a5033e0e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:00 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[908adc2a-a4bf-4082-b2fd-1c937ac04d71]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:00 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 Jul 09 09:30:00 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:00 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.007s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-549e639c-9fd0-47c7-af9a-df8d989640f3 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-a6002422-80e3-456f-aeb5-6c84219d4822-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:01 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608" returned: 0 in 1.015s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:01 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608 Jul 09 09:30:01 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:01 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" returned: 0 in 0.885s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:01 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18447f66-1fbc-4b06-9d6e-4fbd710b4c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391ee623-7db7-4def-8042-c5f331a15116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7" returned: 1 in 1.061s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e494d9a9-1a6f-413d-9cbe-013ca1707940_i0f2zht7' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:30:01 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Volume volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 (8adeeac8-2f1e-4201-afcd-e7f2f0d7b524): created successfully Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391ee623-7db7-4def-8042-c5f331a15116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Flow 'volume_create_manager' (4e89084e-2328-47b0-9175-c88f81f73b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b8409-09a3-4b33-b72b-261db20e44ae]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b79d5f20-d1f8-461c-a77d-319e1f6cb320 tempest-VolumeTypesAccessTest-454951689 None] Created volume successfully. Jul 09 09:30:01 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5" returned: 0 in 0.972s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:01 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5 Jul 09 09:30:01 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:01 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:30:01 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:01 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-feff8972-f5a5-4d43-935b-a4aea5c02608" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-feff8972-f5a5-4d43-935b-a4aea5c02608" released by "delete_volume" :: held 1.808s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['8d72f43c-c21f-482a-bfa3-eb28f08e7430', '9e7f8a01-8ed7-4a10-8822-c7611980ed77', '63a97212-3ffa-469c-a6ce-2fd30aaa493c', '1404f5e0-b715-4de4-b9ae-9e55c24b0dd6'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:01 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:01 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:02 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:02 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f00ae69d-ca24-4f70-8452-151a5033e0e5" returned: 0 in 0.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-c3db7c2e-7e7d-4b4a-8068-d59bf488deca-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-f00ae69d-ca24-4f70-8452-151a5033e0e5" released by "delete_volume" :: held 1.794s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-c3db7c2e-7e7d-4b4a-8068-d59bf488deca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD Jul 09 09:30:02 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-c3db7c2e-7e7d-4b4a-8068-d59bf488deca" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-c3db7c2e-7e7d-4b4a-8068-d59bf488deca" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleting offline snapshot c3db7c2e-7e7d-4b4a-8068-d59bf488deca of volume 9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] snapshot_file for this snap is: volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['b5c78852-a9be-4896-b74d-0e20c80e91ca', '553b8b90-6891-4db7-9dad-534e94b54152', '51e581eb-646c-42da-9c00-152601598a04', '9c4a47e3-5076-4741-8ad6-5403c840647c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9d726-1c18-4f7e-b5c7-3b15a9f6044d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Acquiring lock "cinder-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:02 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:02 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca Jul 09 09:30:02 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "cinder-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Acquiring lock "cinder-quobyte-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "cinder-quobyte-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7028c4-c136-4f8b-81df-1bace81dfada]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4c6c09-8508-4139-94f5-3c5e0e3d427c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:02 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD" returned: 1 in 0.838s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] e494d9a9-1a6f-413d-9cbe-013ca1707940 was raw, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:30:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:03 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.055s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:30:03 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:03 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:03 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c9b0d4a2-0324-4db2-851c-8f0b7f36ab26 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-feff8972-f5a5-4d43-935b-a4aea5c02608-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:03 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:03 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 Jul 09 09:30:03 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:03 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.042s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9dd324c7-cf90-4d6f-9bb6-8be2c492a861 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-f00ae69d-ca24-4f70-8452-151a5033e0e5-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:03 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca" returned: 0 in 1.436s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef850df-0599-429c-8bc2-929f87fd530a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:30:03 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" returned: 0 in 0.995s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56e512-64b2-4f3f-b803-63af83e281d9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:03 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7 Jul 09 09:30:03 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" returned: 0 in 1.167s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:04 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a Jul 09 09:30:04 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524 Jul 09 09:30:04 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 0 in 1.106s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e494d9a9-1a6f-413d-9cbe-013ca1707940_k6od8o43devstack@QuobyteHD, size 0.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:30:04 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:04 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1G Jul 09 09:30:04 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" returned: 0 in 0.700s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7" released by "delete_volume" :: held 1.765s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['1feb158d-f00b-4e2b-833d-46701766e113', '36a7a715-fb1f-486d-9564-e165815df405', 'bf752b86-a255-4315-bdd1-9fdc6c516812', '8c15dad2-029c-40d4-a9af-2b026e8bcbc0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:04 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a" returned: 0 in 0.855s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:04 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:04 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" returned: 0 in 0.761s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:04 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca Jul 09 09:30:04 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "cinder-quobyte-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524" released by "delete_volume" :: held 2.047s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:04 devstack cinder-volume[87265]: WARNING cinder.quota [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-590819211 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-590819211, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:30:04 devstack cinder-volume[87265]: WARNING cinder.quota [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-590819211 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-590819211, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Created reservations ['bf6af85b-56ef-46de-9a5b-acbc465f7bfb', '1d0d4094-949b-48ab-b360-a2caa6e4699a', '7e40c24f-416e-4063-b5dd-84db0b662f76', 'b7bf9a45-0691-474f-9a0b-dca330c6ba8d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-89970d3c-715b-44cf-9fd8-ecb2d2e4710b-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-89970d3c-715b-44cf-9fd8-ecb2d2e4710b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:05 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd 1G" returned: 0 in 1.005s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:05 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:05 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f075940-72ad-4797-a7fc-d709b1a454e8]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0ca04-1571-4bbe-8843-46d396f3902c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:05 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b Jul 09 09:30:05 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:05 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:05 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:05 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.121s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:05 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.778s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Deleted volume successfully. Jul 09 09:30:05 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca" returned: 0 in 1.170s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:05 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca Jul 09 09:30:05 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8976916e-cc1b-4f0b-becb-f4cf5938aaca tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-b96fddbf-200d-4b8a-a4cc-783a7ab3abc7-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7fa64415-9817-45f5-899f-ee5c62db0890 tempest-VolumeTypesAccessTest-454951689 None] Lock "cinder-8adeeac8-2f1e-4201-afcd-e7f2f0d7b524-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:06 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" returned: 0 in 0.883s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:06 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b Jul 09 09:30:06 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:06 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 0 in 1.274s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:06 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:06 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:06 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a.c3db7c2e-7e7d-4b4a-8068-d59bf488deca" returned: 0 in 0.857s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-c3db7c2e-7e7d-4b4a-8068-d59bf488deca" released by "_delete_snapshot" :: held 4.506s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" released by "delete_snapshot" :: held 4.567s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:06 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-89970d3c-715b-44cf-9fd8-ecb2d2e4710b" released by "delete_volume" :: held 1.770s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['7038f106-667a-47a6-9925-52528d93e300', 'ef800a8b-498d-43a2-89df-8329d34d9a2b', '2dc487a0-ece5-43a9-b7c1-4760fc039b93', '4c49f518-969d-401f-8f1b-73ea37e61740'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:06 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['526801c2-ddd7-498d-bb8a-b435f5eadb37', '6ec6b556-2703-4d68-bb16-5d3bc573c5b9', '4132b096-c4f3-4c62-b7e0-35ae3bdd5eb9', '76fdc57b-459a-4d2b-8d9b-be85de28745e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Delete snapshot completed successfully. Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9f499fc2-48bb-4cf7-8dd2-b53eeb5f78b1 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-c3db7c2e-7e7d-4b4a-8068-d59bf488deca-delete_snapshot" released by "delete_snapshot" :: held 4.810s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:07 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:07 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:07 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 1 in 1.010s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Downloaded image e494d9a9-1a6f-413d-9cbe-013ca1707940 ((None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}])) to volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Temporary image e494d9a9-1a6f-413d-9cbe-013ca1707940 for user 1dd682b0718b4314989afefb2ec19570 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Marking volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Copying metadata from image e494d9a9-1a6f-413d-9cbe-013ca1707940 to dad78c63-90a0-48fb-8c6d-fe279ff0edfd. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Creating volume glance metadata for volume dad78c63-90a0-48fb-8c6d-fe279ff0edfd backed by image e494d9a9-1a6f-413d-9cbe-013ca1707940 with: {'image_id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eb1d78569158dc03a8bde881bc93097c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277f836-e299-4c86-901f-ad8cf8d42e82]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b7d43-2d8b-4ea2-83cb-dab7530f8013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd', 'volume_size': 1, 'image_id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e494d9a9-1a6f-413d-9cbe-013ca1707940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb1d78569158dc03a8bde881bc93097c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0f507fee205431398e2f9a0953e742e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca04c622054e26c66a439c78f10a0861f659b998f17b1846c96ad8b297ae5eb36e24d47b88a9fad4dcaa2a397ba7a691eddb0a906e70cffc3c807b057636cb1', 'id': 'e494d9a9-1a6f-413d-9cbe-013ca1707940', 'created_at': datetime.datetime(2026, 7, 9, 7, 29, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 29, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e494d9a9-1a6f-413d-9cbe-013ca1707940/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37dc3b8-338b-4fc4-9b10-aaf45d220fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-9ef850df-0599-429c-8bc2-929f87fd530a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:07 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Volume volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd (dad78c63-90a0-48fb-8c6d-fe279ff0edfd): created successfully Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37dc3b8-338b-4fc4-9b10-aaf45d220fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Flow 'volume_create_manager' (75fc3a68-83ee-4b3f-8659-5bb351a3840f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-9ef850df-0599-429c-8bc2-929f87fd530a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a79162b3-5493-4c47-8490-0736a1e88714 tempest-VolumeImageDependencyTests-310572579 None] Created volume successfully. Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:07 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c Jul 09 09:30:07 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc75ad-7492-4f63-8ca1-e3ea220c1b61]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:07 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.835s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:07 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a Jul 09 09:30:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:07 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4deafceb-1c43-4094-9837-cbd6b756240e tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-89970d3c-715b-44cf-9fd8-ecb2d2e4710b-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Acquiring lock "cinder-dad78c63-90a0-48fb-8c6d-fe279ff0edfd-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "cinder-dad78c63-90a0-48fb-8c6d-fe279ff0edfd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Acquiring lock "cinder-quobyte-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "cinder-quobyte-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d4a6f6-7725-48eb-99c6-58a70369108a]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:08 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" returned: 0 in 1.042s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:08 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c Jul 09 09:30:08 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:08 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:08 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:08 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a" returned: 0 in 1.054s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:08 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a Jul 09 09:30:08 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:09 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" returned: 0 in 0.798s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c" released by "delete_volume" :: held 1.897s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:09 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 0 in 0.892s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['022b42ea-3c6d-4a47-b1c4-9cbd7ed6b3ba', '14cbd622-6418-4e04-a17b-18e266b9cb54', 'f520a3d9-40d0-40e5-a7f8-6221e5210daf', '878cb01e-7310-44bd-b5cf-75ea1c1edf5f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:09 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:09 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:09 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9ef850df-0599-429c-8bc2-929f87fd530a" returned: 0 in 0.899s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:09 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:09 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-quobyte-9ef850df-0599-429c-8bc2-929f87fd530a" released by "delete_volume" :: held 2.028s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Created reservations ['890162ab-f620-4d5a-9952-5dcd5cf4548b', '64ee0f8c-a50d-4117-a145-5eea1c0a36a6', 'ebb1fc91-15d5-4c7c-9332-a49a34b18341', '40ae6b32-9ecc-408b-b1f2-44835c96b5e4'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:09 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:09 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-b1ece798-972c-42a9-850e-489d0f2cf44c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-b1ece798-972c-42a9-850e-489d0f2cf44c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "cinder-quobyte-b1ece798-972c-42a9-850e-489d0f2cf44c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:10 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:10 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 1 in 1.395s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.990s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-b1ece798-972c-42a9-850e-489d0f2cf44c" acquired by "delete_volume" :: waited 0.053s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:10 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd Jul 09 09:30:10 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Deleted volume successfully. Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7fa0c-6bda-4fb4-bda3-b21760fd9fe7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:11 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.291s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-db4a0a8a-57d3-4ebf-8a75-25d6be0d0266 tempest-CreateVolumesFromSnapshotTest-192032833 None] Lock "cinder-9ef850df-0599-429c-8bc2-929f87fd530a-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-fe76ff90-dea6-477c-8e97-b9c81b8cf086 tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-760df3f9-1c41-4ddd-b7cd-0c7d3e64171c-delete_volume" released by "delete_volume" :: held 3.618s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:11 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c Jul 09 09:30:11 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:11 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" returned: 0 in 0.856s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "cinder-quobyte-dad78c63-90a0-48fb-8c6d-fe279ff0edfd" released by "delete_volume" :: held 3.222s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Created reservations ['1db30212-f012-4c83-ad15-1885507f3d1f', 'a6730439-1358-4894-9415-c11379711308', '32d8c7a1-6315-48bd-8ddb-b5b7c8c7900d', '0b520d32-9451-46db-bc23-239001bff177'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:12 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:12 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:12 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c" returned: 0 in 1.085s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:12 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c Jul 09 09:30:12 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:12 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Deleted volume successfully. Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b1f2e69b-c87b-409d-a533-d4f3130b6fb6 tempest-VolumeImageDependencyTests-310572579 None] Lock "cinder-dad78c63-90a0-48fb-8c6d-fe279ff0edfd-delete_volume" released by "delete_volume" :: held 4.306s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:12 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b1ece798-972c-42a9-850e-489d0f2cf44c" returned: 0 in 0.764s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-quobyte-b1ece798-972c-42a9-850e-489d0f2cf44c" released by "delete_volume" :: held 1.912s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Created reservations ['2857ab67-3729-4232-9203-ea1b156ce2c4', 'af5b1268-f820-4d97-b1bd-000ec989d9c7', '2aa67238-798b-4e6c-a684-5a19af856703', '5be37b9d-b108-4488-8608-18b75919ddcd'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:13 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:13 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:13 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.767s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Deleted volume successfully. Jul 09 09:30:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9b11c813-6700-4f69-aa70-a67a3ac1c8da tempest-CreateVolumesFromSourceVolumeTest-1434362627 None] Lock "cinder-b1ece798-972c-42a9-850e-489d0f2cf44c-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Flow 'volume_create_manager' (cc09cf28-87f2-42be-b637-5ffb8aaf0aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4155bd10-3fb1-47ba-854f-f1a7ad1fb0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4155bd10-3fb1-47ba-854f-f1a7ad1fb0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2019716948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1d23ed-dd6e-4aba-9914-57f7936c1624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8446b22eea40048135cf2e842663e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:14Z,use_quota=True,user_id='8d3f81d607d74dd39b0e0407680b1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fd5b75-c93f-478e-b12f-c17f65926ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fd5b75-c93f-478e-b12f-c17f65926ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03874304-31c3-4960-8c28-f52093449196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03874304-31c3-4960-8c28-f52093449196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1d23ed-dd6e-4aba-9914-57f7936c1624', 'volume_name': 'volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b859beeb-cf8b-4ae6-aa79-5c27773b1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b859beeb-cf8b-4ae6-aa79-5c27773b1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47201870-e8d0-4993-8034-47591ce4a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Volume 4b1d23ed-dd6e-4aba-9914-57f7936c1624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624', 'volume_size': 1} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2019716948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1d23ed-dd6e-4aba-9914-57f7936c1624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8446b22eea40048135cf2e842663e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:14Z,use_quota=True,user_id='8d3f81d607d74dd39b0e0407680b1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Creating volume 4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:30:14 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:30:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:14 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 1073741824 Jul 09 09:30:14 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:15 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 1073741824" returned: 0 in 1.213s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:15 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:15 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:16 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.720s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47201870-e8d0-4993-8034-47591ce4a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1dc58c-39cb-46cf-a743-463c59ba0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:16 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Volume volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 (4b1d23ed-dd6e-4aba-9914-57f7936c1624): created successfully Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1dc58c-39cb-46cf-a743-463c59ba0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Flow 'volume_create_manager' (cc09cf28-87f2-42be-b637-5ffb8aaf0aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-375c84dc-9243-4dc0-b75e-117b31d66f78 tempest-VolumeDependencyTests-530788217 None] Created volume successfully. Jul 09 09:30:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Creating offline snapshot 5267d20b-d1e5-4df6-af53-ae55fc60d718 of volume 4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:30:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[53659d8a-28dc-4d44-aeff-b5fb00c0452d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:18 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:18 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Flow 'volume_create_manager' (9596aca2-6de2-4278-bece-11509bb5ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f840df2e-f36b-4999-9ffb-207b085f9c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f840df2e-f36b-4999-9ffb-207b085f9c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdc3c4d-0780-4783-bd5d-3369410a357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bd75c998374ad6bd661278a169ad37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:18Z,use_quota=True,user_id='cada99aa5c814a32873d11f8145086ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e851e-3eb4-4a69-a482-d66889f103e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e851e-3eb4-4a69-a482-d66889f103e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456e9d8-60fd-4e04-b4d6-618b9efa7939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456e9d8-60fd-4e04-b4d6-618b9efa7939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdc3c4d-0780-4783-bd5d-3369410a357e', 'volume_name': 'volume-3cdc3c4d-0780-4783-bd5d-3369410a357e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b05dfb9-5df2-4e4e-bee4-9335940d3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b05dfb9-5df2-4e4e-bee4-9335940d3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d5ff15-de10-4479-acdb-5547c795296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:18 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Volume 3cdc3c4d-0780-4783-bd5d-3369410a357e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdc3c4d-0780-4783-bd5d-3369410a357e', 'volume_size': 1} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:18 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 1.093s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:18 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 1G Jul 09 09:30:18 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:19 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 1G" returned: 0 in 1.013s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:19 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:19 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:20 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 0.770s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:20 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 is being set with open permissions: ugo+rw Jul 09 09:30:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:20 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:20 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:21 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 0.747s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:21 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info Jul 09 09:30:21 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:22 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info" returned: 0 in 0.735s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:22 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info is being set with open permissions: ugo+rw Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:22 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info Jul 09 09:30:22 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:22 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.info" returned: 0 in 0.691s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.200s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.733s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cdc3c4d-0780-4783-bd5d-3369410a357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bd75c998374ad6bd661278a169ad37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:18Z,use_quota=True,user_id='cada99aa5c814a32873d11f8145086ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Creating volume 3cdc3c4d-0780-4783-bd5d-3369410a357e {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:30:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:30:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:22 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e 1073741824 Jul 09 09:30:22 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:23 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b2212071-bc5e-428a-ab0b-f27ed120a1bc tempest-VolumeDependencyTests-530788217 None] Create snapshot completed successfully Jul 09 09:30:23 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e 1073741824" returned: 0 in 1.018s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:24 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e Jul 09 09:30:24 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:30:24 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e" returned: 0 in 0.936s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Flow 'volume_create_manager' (fb18ea6d-0c1f-4451-8fe1-5b36c0b0b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13d8d59-7ce4-4577-8e90-8f8f16de43e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d5ff15-de10-4479-acdb-5547c795296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdc3c4d-0780-4783-bd5d-3369410a357e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa05b3f-053a-4f07-921c-b745d3baf58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13d8d59-7ce4-4577-8e90-8f8f16de43e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1174578093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae500f45-e223-42f4-835b-b8c245a17d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8446b22eea40048135cf2e842663e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5267d20b-d1e5-4df6-af53-ae55fc60d718,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:25Z,use_quota=True,user_id='8d3f81d607d74dd39b0e0407680b1491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89800ce3-3647-4981-8ed4-57d8db5c5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89800ce3-3647-4981-8ed4-57d8db5c5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35b948d-3009-4734-8b4e-29d713b84743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35b948d-3009-4734-8b4e-29d713b84743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae500f45-e223-42f4-835b-b8c245a17d09', 'volume_name': 'volume-ae500f45-e223-42f4-835b-b8c245a17d09', 'volume_size': 1, 'snapshot_id': '5267d20b-d1e5-4df6-af53-ae55fc60d718'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3388093-d98f-4717-8855-1ff0e6eaaf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3388093-d98f-4717-8855-1ff0e6eaaf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cc2811-d1ff-40e2-88ff-ef5ffe358db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Volume ae500f45-e223-42f4-835b-b8c245a17d09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae500f45-e223-42f4-835b-b8c245a17d09', 'volume_size': 1, 'snapshot_id': '5267d20b-d1e5-4df6-af53-ae55fc60d718'} Jul 09 09:30:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Volume volume-3cdc3c4d-0780-4783-bd5d-3369410a357e (3cdc3c4d-0780-4783-bd5d-3369410a357e): created successfully Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa05b3f-053a-4f07-921c-b745d3baf58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Flow 'volume_create_manager' (9596aca2-6de2-4278-bece-11509bb5ac82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718-ae500f45-e223-42f4-835b-b8c245a17d09" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d29ae185-2b93-45dc-a50b-a63c8066f1df tempest-CinderUnicodeTest-309187391 None] Created volume successfully. Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718-ae500f45-e223-42f4-835b-b8c245a17d09" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Creating volume ae500f45-e223-42f4-835b-b8c245a17d09 from snapshot 5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] snapshot: 5267d20b-d1e5-4df6-af53-ae55fc60d718, volume: ae500f45-e223-42f4-835b-b8c245a17d09, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a927a07a-c501-406a-bdb0-625e72d65f00]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:25 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:25 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Flow 'volume_create_manager' (18bd5e78-4a3d-4207-bc95-d312d3008942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a05d08-a6fe-42a3-9b08-bdb792e18651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a05d08-a6fe-42a3-9b08-bdb792e18651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-531864264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66898b27-92d8-4ced-8e51-88008697f21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bd75c998374ad6bd661278a169ad37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:26Z,use_quota=True,user_id='cada99aa5c814a32873d11f8145086ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd20e120-6666-45e1-ad40-e84b707c355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd20e120-6666-45e1-ad40-e84b707c355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c9b340-b221-4474-8899-9c4084d519ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c9b340-b221-4474-8899-9c4084d519ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66898b27-92d8-4ced-8e51-88008697f21c', 'volume_name': 'volume-66898b27-92d8-4ced-8e51-88008697f21c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94126e16-91d4-45b2-8a56-eb4be565a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94126e16-91d4-45b2-8a56-eb4be565a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7aabaf-975c-4f82-97b9-d8e1f8639d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Volume 66898b27-92d8-4ced-8e51-88008697f21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66898b27-92d8-4ced-8e51-88008697f21c', 'volume_size': 1} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:26 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 1.153s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d09dee-3082-45af-9d87-a19735a42093]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:26 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:26 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:27 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.849s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:27 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:30:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:27 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 Jul 09 09:30:27 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:33 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09" returned: 0 in 5.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2357b6e6-6786-4381-b662-dc0208d5d73c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:33 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:33 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:34 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.942s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:30:34 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Converted 1024.00 MB image at 175.62 MB/s Jul 09 09:30:34 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 is being set with open permissions: ugo+rw Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:34 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 Jul 09 09:30:34 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:34 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09" returned: 0 in 0.781s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" released by "_copy_volume_from_snapshot" :: held 9.732s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718-ae500f45-e223-42f4-835b-b8c245a17d09" released by "_create_volume_from_snapshot" :: held 9.769s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.786s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.547s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-531864264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66898b27-92d8-4ced-8e51-88008697f21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bd75c998374ad6bd661278a169ad37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:26Z,use_quota=True,user_id='cada99aa5c814a32873d11f8145086ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Creating volume 66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:30:34 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:34 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c 1073741824 Jul 09 09:30:34 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cc2811-d1ff-40e2-88ff-ef5ffe358db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae500f45-e223-42f4-835b-b8c245a17d09', 'volume_size': 1, 'snapshot_id': '5267d20b-d1e5-4df6-af53-ae55fc60d718'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384d7a9-022e-4900-933d-501b61b3f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:34 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Volume volume-ae500f45-e223-42f4-835b-b8c245a17d09 (ae500f45-e223-42f4-835b-b8c245a17d09): created successfully Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384d7a9-022e-4900-933d-501b61b3f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Flow 'volume_create_manager' (fb18ea6d-0c1f-4451-8fe1-5b36c0b0b523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-95e42e7c-6034-4bdd-8e5b-89c3fcdd660e tempest-VolumeDependencyTests-530788217 None] Created volume successfully. Jul 09 09:30:35 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c 1073741824" returned: 0 in 0.852s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:35 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c Jul 09 09:30:35 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-5267d20b-d1e5-4df6-af53-ae55fc60d718-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-5267d20b-d1e5-4df6-af53-ae55fc60d718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Deleting offline snapshot 5267d20b-d1e5-4df6-af53-ae55fc60d718 of volume 4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] snapshot_file for this snap is: volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ecc6ae-5a8d-4bf9-93b9-a9aa516b0a86]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:36 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:36 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:36 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7aabaf-975c-4f82-97b9-d8e1f8639d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66898b27-92d8-4ced-8e51-88008697f21c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1231f1b1-88aa-4360-b195-591527bde459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:36 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Volume volume-66898b27-92d8-4ced-8e51-88008697f21c (66898b27-92d8-4ced-8e51-88008697f21c): created successfully Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1231f1b1-88aa-4360-b195-591527bde459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Flow 'volume_create_manager' (18bd5e78-4a3d-4207-bc95-d312d3008942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23e81e92-58e5-424f-8bc1-29247de3e5a3 tempest-CinderUnicodeTest-309187391 None] Created volume successfully. Jul 09 09:30:36 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 0.866s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfc6a9-3411-42df-89da-140839574049]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:36 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:36 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:37 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.849s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Creating offline snapshot 2015f55c-f467-4df2-8779-1b9204674c5c of volume 66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:30:37 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:37 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd517f0-515e-4323-9ff3-589ea4b96e07]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:37 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c Jul 09 09:30:37 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:38 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 0.838s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:38 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718 Jul 09 09:30:38 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:38 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c" returned: 0 in 0.867s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:38 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c 1G Jul 09 09:30:38 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:39 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624.5267d20b-d1e5-4df6-af53-ae55fc60d718" returned: 0 in 0.719s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-5267d20b-d1e5-4df6-af53-ae55fc60d718" released by "_delete_snapshot" :: held 3.393s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" released by "delete_snapshot" :: held 3.421s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Created reservations ['3a805246-1b59-4c9d-949c-aac32b320730', '082677e6-9fed-4e09-883b-eded4a415a77', '441eafeb-d185-4c38-a93a-abe396d05220', '18ac367e-28a7-4544-a214-f6a568d4c393'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Delete snapshot completed successfully. Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8bb6709b-195f-4a43-9973-18e749dad7a2 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-5267d20b-d1e5-4df6-af53-ae55fc60d718-delete_snapshot" released by "delete_snapshot" :: held 3.592s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:39 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c 1G" returned: 0 in 0.895s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66898b27-92d8-4ced-8e51-88008697f21c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:39 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66898b27-92d8-4ced-8e51-88008697f21c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c Jul 09 09:30:39 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-4b1d23ed-dd6e-4aba-9914-57f7936c1624-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-4b1d23ed-dd6e-4aba-9914-57f7936c1624-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eff52b-d44d-4c8e-89be-8e44f623639e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:40 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66898b27-92d8-4ced-8e51-88008697f21c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c" returned: 0 in 0.796s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:40 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c is being set with open permissions: ugo+rw Jul 09 09:30:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:40 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c Jul 09 09:30:40 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:40 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:40 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:41 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c" returned: 0 in 0.692s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=133,cinder:INSERT=42,cinder:UPDATE=178,cinder:DELETE=9 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=167,cinder:DELETE=23,cinder:SELECT=115,cinder:INSERT=47 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:30:41 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.831s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:41 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info Jul 09 09:30:41 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:41 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624 Jul 09 09:30:41 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:41 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info" returned: 0 in 0.842s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:41 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info is being set with open permissions: ugo+rw Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:41 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4b1d23ed-dd6e-4aba-9914-57f7936c1624" returned: 0 in 0.857s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:41 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info Jul 09 09:30:41 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-4b1d23ed-dd6e-4aba-9914-57f7936c1624" released by "delete_volume" :: held 1.767s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Created reservations ['b876fab6-2e9d-45bc-9e5b-92dba459fdb5', '2331f174-ca74-4b95-92a4-47d2c25822c9', 'f32f351c-76bd-4fe7-b8c4-4cbaa6df0ac1', '31a016fc-61bb-4dc4-bb7b-5a7418a3183a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:42 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:42 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-ae500f45-e223-42f4-835b-b8c245a17d09-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-ae500f45-e223-42f4-835b-b8c245a17d09-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b272b84-d3bc-4003-b9ed-6f1924b8bd31]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:42 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.info" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.019s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:42 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 Jul 09 09:30:42 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-62793ac7-c9b4-4e78-8fb6-09c60fb580de tempest-CinderUnicodeTest-309187391 None] Create snapshot completed successfully Jul 09 09:30:42 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Deleted volume successfully. Jul 09 09:30:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e31c751b-73c0-4399-8022-06b5c653bb19 tempest-VolumeDependencyTests-530788217 None] Lock "cinder-4b1d23ed-dd6e-4aba-9914-57f7936c1624-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-2015f55c-f467-4df2-8779-1b9204674c5c-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-2015f55c-f467-4df2-8779-1b9204674c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-quobyte-2015f55c-f467-4df2-8779-1b9204674c5c" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-2015f55c-f467-4df2-8779-1b9204674c5c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Deleting offline snapshot 2015f55c-f467-4df2-8779-1b9204674c5c of volume 66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] snapshot_file for this snap is: volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b1960-3e6d-42b5-84cb-c79fb582178f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:43 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c Jul 09 09:30:43 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:43 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09" returned: 0 in 0.919s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:43 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09 Jul 09 09:30:43 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:43 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66898b27-92d8-4ced-8e51-88008697f21c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0e97d6-05ea-4f0a-939a-85e4ae13659f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:44 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c Jul 09 09:30:44 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:44 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ae500f45-e223-42f4-835b-b8c245a17d09" returned: 0 in 0.730s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-quobyte-ae500f45-e223-42f4-835b-b8c245a17d09" released by "delete_volume" :: held 1.700s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Created reservations ['2d505319-4da1-47ac-82f8-92ded9fe22ef', 'd9617006-3b9c-44aa-b3ed-1d44102dd59c', '56fe0716-7fa4-4c62-826e-ea502306ccb9', '8f1d570c-9fe3-4203-9063-edc4175c2ddc'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:44 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:44 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:44 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c" returned: 0 in 0.859s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:44 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c Jul 09 09:30:44 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:45 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.794s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:45 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:45 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Deleted volume successfully. Jul 09 09:30:45 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7b5db6ad-80bd-4df7-9cd0-9a82fd1b007e tempest-VolumeDependencyTests-530788217 None] Lock "cinder-ae500f45-e223-42f4-835b-b8c245a17d09-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:45 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c" returned: 0 in 0.922s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:45 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c Jul 09 09:30:45 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:46 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c.2015f55c-f467-4df2-8779-1b9204674c5c" returned: 0 in 0.743s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-2015f55c-f467-4df2-8779-1b9204674c5c" released by "_delete_snapshot" :: held 3.489s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" released by "delete_snapshot" :: held 3.523s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Created reservations ['a9f90b6d-5cfe-4e73-a56c-5c04d61b69f6', 'f4553afd-6f66-4293-a8af-1f03925c98d0', '7d653120-e7c4-4754-b519-faf2819a0d45', '93de3150-d6a5-4a04-917f-200e9006dc20'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Delete snapshot completed successfully. Jul 09 09:30:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-279c66e3-1436-4daf-9862-a82fe164c9f3 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-2015f55c-f467-4df2-8779-1b9204674c5c-delete_snapshot" released by "delete_snapshot" :: held 3.704s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-66898b27-92d8-4ced-8e51-88008697f21c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-66898b27-92d8-4ced-8e51-88008697f21c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8226ad-2f83-4e33-92a0-de5ba85c7c70]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:47 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c Jul 09 09:30:47 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:48 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:48 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c Jul 09 09:30:48 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:48 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-66898b27-92d8-4ced-8e51-88008697f21c" returned: 0 in 0.679s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-66898b27-92d8-4ced-8e51-88008697f21c" released by "delete_volume" :: held 1.600s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Created reservations ['7c40e4e6-d851-441d-987f-ebe9f54cb33e', '7a525665-75d3-4d5e-86bb-d09fbbe57e04', '950a88f1-f30c-4c89-b95e-2276305e3b58', 'ddf35a75-6bc6-4758-8847-594ef0fbe24e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:49 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:49 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-3cdc3c4d-0780-4783-bd5d-3369410a357e-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-3cdc3c4d-0780-4783-bd5d-3369410a357e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "cinder-quobyte-3cdc3c4d-0780-4783-bd5d-3369410a357e" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-3cdc3c4d-0780-4783-bd5d-3369410a357e" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6199f-75f4-4d79-9b2e-e774eecc7ece]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:49 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e Jul 09 09:30:49 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:49 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.684s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Deleted volume successfully. Jul 09 09:30:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ea1d68e1-6b43-46ef-98b6-eea310f1af59 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-66898b27-92d8-4ced-8e51-88008697f21c-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:50 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e" returned: 0 in 0.857s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:50 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:50 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:50 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e Jul 09 09:30:50 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:51 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:30:51 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3cdc3c4d-0780-4783-bd5d-3369410a357e" returned: 0 in 0.748s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-quobyte-3cdc3c4d-0780-4783-bd5d-3369410a357e" released by "delete_volume" :: held 1.654s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Created reservations ['71317318-50f7-4733-9948-08d2ecae4676', 'e2a82a22-d406-4fc0-b872-a4d2e7b6b595', '905f0568-7c6e-40be-918a-95bea0562009', 'c8523d92-a8c1-4fb6-9a2b-dac9fa6950fd'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:51 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:51 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:52 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:52 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:30:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Deleted volume successfully. Jul 09 09:30:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d5f427d-407b-43f4-9e4c-072c32d18ce5 tempest-CinderUnicodeTest-309187391 None] Lock "cinder-3cdc3c4d-0780-4783-bd5d-3369410a357e-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Flow 'volume_create_manager' (09c9bc5f-9697-4ca9-a11d-35e314c4539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6ef083-a675-43e4-8f06-9951b5d5d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6ef083-a675-43e4-8f06-9951b5d5d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474410037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23805d5a-6494-4fc6-b718-76361490f2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0f426872e4c368cf3a9547e2568ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:56Z,use_quota=True,user_id='2ce51258d243451a8daa5988e97f0104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd70d8-d7a9-4466-bed9-f6d0c76b0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd70d8-d7a9-4466-bed9-f6d0c76b0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68b2d28-014b-434c-8f1a-1d414cca197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68b2d28-014b-434c-8f1a-1d414cca197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23805d5a-6494-4fc6-b718-76361490f2e0', 'volume_name': 'volume-23805d5a-6494-4fc6-b718-76361490f2e0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc1a8b-0d4d-42f4-9d59-ba1478e896b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc1a8b-0d4d-42f4-9d59-ba1478e896b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9f7162-f702-40e1-9923-e88384e9e570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Volume 23805d5a-6494-4fc6-b718-76361490f2e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23805d5a-6494-4fc6-b718-76361490f2e0', 'volume_size': 1} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474410037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23805d5a-6494-4fc6-b718-76361490f2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0f426872e4c368cf3a9547e2568ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:30:56Z,use_quota=True,user_id='2ce51258d243451a8daa5988e97f0104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Creating volume 23805d5a-6494-4fc6-b718-76361490f2e0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:30:55 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:30:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:55 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 1073741824 Jul 09 09:30:55 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:56 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 1073741824" returned: 0 in 0.827s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:56 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 Jul 09 09:30:56 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:57 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9f7162-f702-40e1-9923-e88384e9e570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23805d5a-6494-4fc6-b718-76361490f2e0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5398ee86-b0f7-4799-b3e8-d297cb90929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:30:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Volume volume-23805d5a-6494-4fc6-b718-76361490f2e0 (23805d5a-6494-4fc6-b718-76361490f2e0): created successfully Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5398ee86-b0f7-4799-b3e8-d297cb90929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Flow 'volume_create_manager' (09c9bc5f-9697-4ca9-a11d-35e314c4539b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:30:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-76b6906a-033b-43b3-b93c-98d8122dec24 tempest-ProjectReaderTests-677846498 None] Created volume successfully. Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Acquiring lock "cinder-23805d5a-6494-4fc6-b718-76361490f2e0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "cinder-23805d5a-6494-4fc6-b718-76361490f2e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Acquiring lock "cinder-quobyte-23805d5a-6494-4fc6-b718-76361490f2e0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "cinder-quobyte-23805d5a-6494-4fc6-b718-76361490f2e0" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8383eb5b-b66f-478d-bfd6-3b640f382b6f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:30:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:58 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 Jul 09 09:30:58 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:58 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0" returned: 0 in 0.804s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:58 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0 Jul 09 09:30:58 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:30:59 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-23805d5a-6494-4fc6-b718-76361490f2e0" returned: 0 in 0.755s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "cinder-quobyte-23805d5a-6494-4fc6-b718-76361490f2e0" released by "delete_volume" :: held 1.598s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Created reservations ['d6c4ae0d-bba1-4a75-aea9-953e41e4b0e4', '84dfb60f-d8d7-4033-ad1f-b500bb3753ef', 'cf608824-d186-4042-808e-71e70aa3782f', '485609c4-b73a-4954-a623-3dfdef6af8fb'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:30:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:30:59 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:30:59 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:00 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.728s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Deleted volume successfully. Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8861d11d-d866-476b-b828-081fdc0bfded tempest-ProjectReaderTests-677846498 None] Lock "cinder-23805d5a-6494-4fc6-b718-76361490f2e0-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Flow 'volume_create_manager' (89328eda-d6dd-4c46-a7cb-614eaa67a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42934e39-b0df-4198-9ef3-d79021c250f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42934e39-b0df-4198-9ef3-d79021c250f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554571238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1a804-9d62-497b-900d-4f86fef59669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0f426872e4c368cf3a9547e2568ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:01Z,use_quota=True,user_id='2ce51258d243451a8daa5988e97f0104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963305a6-ba43-47e8-90fd-5becf770d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963305a6-ba43-47e8-90fd-5becf770d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b4792-ff3c-43ac-aa6e-b98dc0120f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b4792-ff3c-43ac-aa6e-b98dc0120f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d1a804-9d62-497b-900d-4f86fef59669', 'volume_name': 'volume-57d1a804-9d62-497b-900d-4f86fef59669', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ac1df3-b58d-45d8-88e3-fa64747bcc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ac1df3-b58d-45d8-88e3-fa64747bcc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4638eb-b40f-4558-978a-d0757b63ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Volume 57d1a804-9d62-497b-900d-4f86fef59669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d1a804-9d62-497b-900d-4f86fef59669', 'volume_size': 1} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554571238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1a804-9d62-497b-900d-4f86fef59669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0f426872e4c368cf3a9547e2568ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:01Z,use_quota=True,user_id='2ce51258d243451a8daa5988e97f0104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Creating volume 57d1a804-9d62-497b-900d-4f86fef59669 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:00 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:00 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 1073741824 Jul 09 09:31:00 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:01 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 1073741824" returned: 0 in 0.827s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:01 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 Jul 09 09:31:01 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:02 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669" returned: 0 in 0.633s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4638eb-b40f-4558-978a-d0757b63ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d1a804-9d62-497b-900d-4f86fef59669', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12fb583-7b29-4c86-a2b1-4343486241c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Volume volume-57d1a804-9d62-497b-900d-4f86fef59669 (57d1a804-9d62-497b-900d-4f86fef59669): created successfully Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12fb583-7b29-4c86-a2b1-4343486241c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Flow 'volume_create_manager' (89328eda-d6dd-4c46-a7cb-614eaa67a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-93ce44e3-1107-4357-9d61-6bc9abe4c5b2 tempest-ProjectReaderTests-677846498 None] Created volume successfully. Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Acquiring lock "cinder-57d1a804-9d62-497b-900d-4f86fef59669-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "cinder-57d1a804-9d62-497b-900d-4f86fef59669-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Acquiring lock "cinder-quobyte-57d1a804-9d62-497b-900d-4f86fef59669" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "cinder-quobyte-57d1a804-9d62-497b-900d-4f86fef59669" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54fb7c0-0107-4fc6-afd0-d4e5cc376415]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:02 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 Jul 09 09:31:02 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:03 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669" returned: 0 in 0.748s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:03 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669 Jul 09 09:31:03 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:04 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-57d1a804-9d62-497b-900d-4f86fef59669" returned: 0 in 0.768s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "cinder-quobyte-57d1a804-9d62-497b-900d-4f86fef59669" released by "delete_volume" :: held 1.557s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Created reservations ['81780e8b-06b1-44ce-a91d-20150542d428', 'af43a33d-b945-4960-b104-cd8b35694ed2', '4ed0d5d7-a462-470b-b36e-cb9b40c70be1', 'f9f3a971-78ac-4e3f-9a24-8a3527f596a5'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:04 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:04 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:05 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.691s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Deleted volume successfully. Jul 09 09:31:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d6d40dc-bdfd-49b4-8fd8-c76ff38eb7bb tempest-ProjectReaderTests-677846498 None] Lock "cinder-57d1a804-9d62-497b-900d-4f86fef59669-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:08 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (3a238dc5-9788-4b28-a31d-deda6f497a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cf2a26-20c9-4ced-b648-8bb9ee827799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cf2a26-20c9-4ced-b648-8bb9ee827799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666798124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd07ee17-1125-42fc-af85-88239a1b9b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:09Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61ae936-c703-4b4e-b762-04cbbd379bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61ae936-c703-4b4e-b762-04cbbd379bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a708bbed-a978-4ebf-9caa-f514bbb52659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a708bbed-a978-4ebf-9caa-f514bbb52659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd07ee17-1125-42fc-af85-88239a1b9b24', 'volume_name': 'volume-dd07ee17-1125-42fc-af85-88239a1b9b24', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de3ae7b-5689-4681-9a79-a29d982bace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de3ae7b-5689-4681-9a79-a29d982bace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a4d281-08b6-4c56-be8b-2a1ac28c9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Volume dd07ee17-1125-42fc-af85-88239a1b9b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd07ee17-1125-42fc-af85-88239a1b9b24', 'volume_size': 1} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666798124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd07ee17-1125-42fc-af85-88239a1b9b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:09Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Creating volume dd07ee17-1125-42fc-af85-88239a1b9b24 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:09 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:09 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 1073741824 Jul 09 09:31:09 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (73ec90d5-e7c2-4e7e-95e8-d80a09471578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b8200c-9416-42c2-9286-c67ada1a1f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b8200c-9416-42c2-9286-c67ada1a1f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1763678176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab13988b-d984-48a5-aa19-46da212fe4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:09Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290a47c9-5bfa-4125-92b7-93d88ba111a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290a47c9-5bfa-4125-92b7-93d88ba111a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c14322-1402-4489-94b1-bcb50bb3bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c14322-1402-4489-94b1-bcb50bb3bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab13988b-d984-48a5-aa19-46da212fe4a1', 'volume_name': 'volume-ab13988b-d984-48a5-aa19-46da212fe4a1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4fc5e2-7425-4512-9c5b-746832e4934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4fc5e2-7425-4512-9c5b-746832e4934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603d88a3-9e06-478a-9b26-db9344dc3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:09 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Volume ab13988b-d984-48a5-aa19-46da212fe4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab13988b-d984-48a5-aa19-46da212fe4a1', 'volume_size': 1} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:09 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 1073741824" returned: 0 in 0.865s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:09 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 Jul 09 09:31:09 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:10 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24" returned: 0 in 0.662s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1763678176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab13988b-d984-48a5-aa19-46da212fe4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:09Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Creating volume ab13988b-d984-48a5-aa19-46da212fe4a1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:10 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:10 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 1073741824 Jul 09 09:31:10 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a4d281-08b6-4c56-be8b-2a1ac28c9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd07ee17-1125-42fc-af85-88239a1b9b24', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc6cb05-7d03-4e5e-9518-7ccc2974750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:10 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Volume volume-dd07ee17-1125-42fc-af85-88239a1b9b24 (dd07ee17-1125-42fc-af85-88239a1b9b24): created successfully Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc6cb05-7d03-4e5e-9518-7ccc2974750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (3a238dc5-9788-4b28-a31d-deda6f497a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-91a19f0e-d007-4658-b4fd-e23e971d6204 tempest-ProjectReaderTests-744643402 None] Created volume successfully. Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-dd07ee17-1125-42fc-af85-88239a1b9b24-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "cinder-dd07ee17-1125-42fc-af85-88239a1b9b24-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-quobyte-dd07ee17-1125-42fc-af85-88239a1b9b24" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-dd07ee17-1125-42fc-af85-88239a1b9b24" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc2c35a-fc8f-4d60-8484-9888c241b139]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:11 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 Jul 09 09:31:11 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:11 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 1073741824" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:11 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 Jul 09 09:31:11 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:12 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24" returned: 0 in 0.792s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:12 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24 Jul 09 09:31:12 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:12 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1" returned: 0 in 0.684s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603d88a3-9e06-478a-9b26-db9344dc3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab13988b-d984-48a5-aa19-46da212fe4a1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba04bf-419e-4aee-9097-ce22aaa31894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Volume volume-ab13988b-d984-48a5-aa19-46da212fe4a1 (ab13988b-d984-48a5-aa19-46da212fe4a1): created successfully Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baba04bf-419e-4aee-9097-ce22aaa31894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (73ec90d5-e7c2-4e7e-95e8-d80a09471578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f97f71df-ce03-4e22-abbc-3f7b1a844c7d tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-413424dc-4277-452f-af93-5c99f78b2416 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1" by "attach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-413424dc-4277-452f-af93-5c99f78b2416 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1" acquired by "attach_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-413424dc-4277-452f-af93-5c99f78b2416 tempest-VolumesActionsTest-1505409356 None] Attaching volume ab13988b-d984-48a5-aa19-46da212fe4a1 to instance b3adc1fe-b909-4783-8b1b-568b0bfcaf48 at mountpoint /dev/vdb on host None. Jul 09 09:31:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-413424dc-4277-452f-af93-5c99f78b2416 tempest-VolumesActionsTest-1505409356 None] Attach volume completed successfully. Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-413424dc-4277-452f-af93-5c99f78b2416 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1" released by "attach_volume" :: held 0.094s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:12 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-dd07ee17-1125-42fc-af85-88239a1b9b24" returned: 0 in 0.709s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-dd07ee17-1125-42fc-af85-88239a1b9b24" released by "delete_volume" :: held 1.549s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Created reservations ['8baa4830-4f1a-4b9b-8abf-71c21091a293', '43cf881d-e3dc-463a-b4e6-772980850c2b', '25ba1d31-862a-42fa-a6a1-7ba78c12b45f', '0853a4c3-b68e-4729-9049-8753f36c7f1f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:12 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:12 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Terminate volume connection completed successfully. Jul 09 09:31:13 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.716s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Deleted volume successfully. Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca81caff-5f16-4ac5-9749-2a555d6124db tempest-ProjectReaderTests-744643402 None] Lock "cinder-dd07ee17-1125-42fc-af85-88239a1b9b24-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (c659340e-f3f4-4dfc-bdff-19b6174418e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248e54a-3ac3-4fde-b777-d7a5830e941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248e54a-3ac3-4fde-b777-d7a5830e941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444572878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:14Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafb7408-f65b-481c-b144-d669104dc9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafb7408-f65b-481c-b144-d669104dc9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf01766-4a76-43a0-95ed-599e2b0a8c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf01766-4a76-43a0-95ed-599e2b0a8c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf', 'volume_name': 'volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd624ea6-9269-490b-aa86-2807e2251951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd624ea6-9269-490b-aa86-2807e2251951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aec3f35-790b-42d2-a9f0-6bb32fc9175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:14 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Volume cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf', 'volume_size': 1} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444572878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:14Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Creating volume cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:14 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:14 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf 1073741824 Jul 09 09:31:14 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" by "detach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Detaching volume ab13988b-d984-48a5-aa19-46da212fe4a1 from instance b3adc1fe-b909-4783-8b1b-568b0bfcaf48. Jul 09 09:31:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Detach volume completed successfully. Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-063ac5a9-c492-4e91-bff7-f9a28227c0e5 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0eb9153a-18ae-4cc4-abe9-8035dbd60ac0 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" by "detach_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:14 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0eb9153a-18ae-4cc4-abe9-8035dbd60ac0 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0eb9153a-18ae-4cc4-abe9-8035dbd60ac0 tempest-VolumesActionsTest-1505409356 None] Volume detach called, but volume not attached. Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf 1073741824" returned: 0 in 0.888s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0eb9153a-18ae-4cc4-abe9-8035dbd60ac0 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:14 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf Jul 09 09:31:14 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:15 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" returned: 0 in 0.681s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aec3f35-790b-42d2-a9f0-6bb32fc9175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcde58b6-7ed6-40c1-a2c4-c9bd5f2e8635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-quobyte-ab13988b-d984-48a5-aa19-46da212fe4a1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:15 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Volume volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf (cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf): created successfully Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcde58b6-7ed6-40c1-a2c4-c9bd5f2e8635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (c659340e-f3f4-4dfc-bdff-19b6174418e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-quobyte-ab13988b-d984-48a5-aa19-46da212fe4a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-be12a267-8a2b-4524-8faa-444532118417 tempest-ProjectReaderTests-744643402 None] Created volume successfully. Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e650fb-3ef3-45ff-bcf6-bf242519e832]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:15 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 Jul 09 09:31:15 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "cinder-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-quobyte-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[763508b0-bda2-4c2a-a943-47b71c6f0b41]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:16 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf Jul 09 09:31:16 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:16 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1" returned: 0 in 0.783s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:16 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1 Jul 09 09:31:16 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:17 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" returned: 0 in 0.809s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:17 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf Jul 09 09:31:17 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:17 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-ab13988b-d984-48a5-aa19-46da212fe4a1" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-quobyte-ab13988b-d984-48a5-aa19-46da212fe4a1" released by "delete_volume" :: held 1.494s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Created reservations ['8b9840b7-aa19-4737-9981-97dfdf5eab1b', '3f606ab8-410a-4a50-aa68-3a42cfedc349', '17524e27-fb0a-4cb6-91d9-1ffe083cd525', 'f295a3a9-3ff8-424b-b8db-bfa9ea716bf7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:17 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:17 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:17 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" returned: 0 in 0.708s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf" released by "delete_volume" :: held 1.560s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Created reservations ['c93c6b85-2b8c-4aa0-8908-adaf0b393018', '6ee19c43-0db1-4125-97f3-baba43a7d801', '3a9e3f08-9fff-4fd6-ace1-525f3fa724d3', '12efec84-47b6-4320-b1c9-6fddc967fa7a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:17 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:17 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:18 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Deleted volume successfully. Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d0ddddfc-8bf8-4ae0-aac7-4b576f776345 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-ab13988b-d984-48a5-aa19-46da212fe4a1-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:18 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.864s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Deleted volume successfully. Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-733fb7b2-c0e8-4bcd-8e05-bdc09a67c44f tempest-ProjectReaderTests-744643402 None] Lock "cinder-cfe4c1b6-e0d6-46b8-813b-0edaf748dfaf-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (2ed51556-1db9-4ffc-990d-b03b98e92621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14fada8-9f39-4e30-8ff5-ad3b2e1fbf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14fada8-9f39-4e30-8ff5-ad3b2e1fbf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373567290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4614289-81e2-492a-b022-359a84dee181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:19Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f071d8a8-d966-4433-a716-3765c3748c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f071d8a8-d966-4433-a716-3765c3748c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edad84ed-4799-46a4-b397-b89f2a859914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edad84ed-4799-46a4-b397-b89f2a859914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4614289-81e2-492a-b022-359a84dee181', 'volume_name': 'volume-e4614289-81e2-492a-b022-359a84dee181', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a94b38-1225-42e9-af36-c39e863a1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a94b38-1225-42e9-af36-c39e863a1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdf7b93-6bf1-4228-8a4a-42167df7afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:19 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Volume e4614289-81e2-492a-b022-359a84dee181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4614289-81e2-492a-b022-359a84dee181', 'volume_size': 1} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1373567290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4614289-81e2-492a-b022-359a84dee181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:19Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Creating volume e4614289-81e2-492a-b022-359a84dee181 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:19 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:19 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 1073741824 Jul 09 09:31:19 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:20 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 1073741824" returned: 0 in 0.958s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:20 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 Jul 09 09:31:20 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:20 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdf7b93-6bf1-4228-8a4a-42167df7afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4614289-81e2-492a-b022-359a84dee181', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2f8e4a-54ab-4179-abbd-430e09596a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Volume volume-e4614289-81e2-492a-b022-359a84dee181 (e4614289-81e2-492a-b022-359a84dee181): created successfully Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2f8e4a-54ab-4179-abbd-430e09596a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (2ed51556-1db9-4ffc-990d-b03b98e92621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:20 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-245f58b3-aa43-4394-8007-dcb5d42604a6 tempest-ProjectReaderTests-744643402 None] Created volume successfully. Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-e4614289-81e2-492a-b022-359a84dee181-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "cinder-e4614289-81e2-492a-b022-359a84dee181-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-quobyte-e4614289-81e2-492a-b022-359a84dee181" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-e4614289-81e2-492a-b022-359a84dee181" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b0159c-0a29-43c0-8e0f-c3f36314eb9b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:21 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 Jul 09 09:31:21 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:21 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181" returned: 0 in 0.747s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:21 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181 Jul 09 09:31:21 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:22 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e4614289-81e2-492a-b022-359a84dee181" returned: 0 in 0.647s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-e4614289-81e2-492a-b022-359a84dee181" released by "delete_volume" :: held 1.436s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Created reservations ['2e1ad56a-b163-454f-8cac-cfd8964e4dcb', '698fa523-044a-4bf4-acdb-00d8d34afd76', '0dbb1d5a-39c4-4427-ad9a-0cdcaf70ba82', '485bc92e-e960-443d-b164-4ebb10e4c5a1'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:22 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:22 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:23 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.644s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:23 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Deleted volume successfully. Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-599ad984-da9f-4c69-8800-851411ed6e96 tempest-ProjectReaderTests-744643402 None] Lock "cinder-e4614289-81e2-492a-b022-359a84dee181-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (3f1e7c94-b329-4f52-bd6a-f73a215fe676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4028764-6a42-4e20-a90b-4f00e09b40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4028764-6a42-4e20-a90b-4f00e09b40d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855100652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304875e2-0030-430c-8025-71de044d59a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:24Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8080b03-a955-4ba3-a865-2b35fcf6aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8080b03-a955-4ba3-a865-2b35fcf6aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eb323b-7d23-4ed4-9ac2-ba7636f968d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eb323b-7d23-4ed4-9ac2-ba7636f968d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304875e2-0030-430c-8025-71de044d59a1', 'volume_name': 'volume-304875e2-0030-430c-8025-71de044d59a1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8224e2-7382-4414-b9fd-b8e9317cf6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8224e2-7382-4414-b9fd-b8e9317cf6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2153790-ee84-4568-9123-d03b16d9ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:23 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Volume 304875e2-0030-430c-8025-71de044d59a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304875e2-0030-430c-8025-71de044d59a1', 'volume_size': 1} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855100652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304875e2-0030-430c-8025-71de044d59a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de423b6842e4a05b43c9f3748cafa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:24Z,use_quota=True,user_id='c027a495e8ef4d9797e982053aeb353e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Creating volume 304875e2-0030-430c-8025-71de044d59a1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:23 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:23 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 1073741824 Jul 09 09:31:23 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:24 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 1073741824" returned: 0 in 0.793s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:24 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 Jul 09 09:31:24 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:25 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1" returned: 0 in 0.631s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2153790-ee84-4568-9123-d03b16d9ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304875e2-0030-430c-8025-71de044d59a1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5ddf84-1621-43a5-927c-4e74334b7adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Volume volume-304875e2-0030-430c-8025-71de044d59a1 (304875e2-0030-430c-8025-71de044d59a1): created successfully Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5ddf84-1621-43a5-927c-4e74334b7adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Flow 'volume_create_manager' (3f1e7c94-b329-4f52-bd6a-f73a215fe676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ba91a5f8-c1a9-418a-8c2a-aeffd46ed49a tempest-ProjectReaderTests-744643402 None] Created volume successfully. Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (e03e073e-6a3e-41fe-8d6a-cdd162428c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45a291c-1054-497e-b352-dfdf8f965731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45a291c-1054-497e-b352-dfdf8f965731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233416763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16141f3-7672-4a51-8d5a-8152f2c91332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:26Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224451d1-43c0-456d-aa20-96d0e047a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224451d1-43c0-456d-aa20-96d0e047a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed55da7a-355b-40a8-9953-9d2625635424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed55da7a-355b-40a8-9953-9d2625635424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16141f3-7672-4a51-8d5a-8152f2c91332', 'volume_name': 'volume-b16141f3-7672-4a51-8d5a-8152f2c91332', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd622b11-37d6-41d8-a981-9f04e8e0ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd622b11-37d6-41d8-a981-9f04e8e0ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67691714-6bdb-4069-b962-bbc837ae11d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Volume b16141f3-7672-4a51-8d5a-8152f2c91332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16141f3-7672-4a51-8d5a-8152f2c91332', 'volume_size': 1} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233416763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16141f3-7672-4a51-8d5a-8152f2c91332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:26Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Creating volume b16141f3-7672-4a51-8d5a-8152f2c91332 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:25 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:25 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 1073741824 Jul 09 09:31:25 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-304875e2-0030-430c-8025-71de044d59a1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "cinder-304875e2-0030-430c-8025-71de044d59a1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Acquiring lock "cinder-quobyte-304875e2-0030-430c-8025-71de044d59a1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-304875e2-0030-430c-8025-71de044d59a1" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c490e8b5-1c88-42bf-aaa9-0c8e9f84d220]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:26 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 Jul 09 09:31:26 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:26 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 1073741824" returned: 0 in 0.830s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:26 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 Jul 09 09:31:26 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:26 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:26 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1 Jul 09 09:31:26 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:27 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332" returned: 0 in 0.663s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67691714-6bdb-4069-b962-bbc837ae11d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16141f3-7672-4a51-8d5a-8152f2c91332', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3884b5-7b2a-4161-9c5a-15c332e83bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:27 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Volume volume-b16141f3-7672-4a51-8d5a-8152f2c91332 (b16141f3-7672-4a51-8d5a-8152f2c91332): created successfully Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3884b5-7b2a-4161-9c5a-15c332e83bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (e03e073e-6a3e-41fe-8d6a-cdd162428c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4cff8424-df5a-456f-9d78-24f5c9df1954 tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:27 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-304875e2-0030-430c-8025-71de044d59a1" returned: 0 in 0.665s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "cinder-quobyte-304875e2-0030-430c-8025-71de044d59a1" released by "delete_volume" :: held 1.512s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Created reservations ['c05bae35-8f43-42d2-8478-95a6b9cda12f', '178b4f90-57d3-4996-beea-1eb57622b8bd', '643158fb-bebd-46db-9c2b-25b174aa59a7', 'e3a84633-8028-4d7c-8f55-434a6ac139fa'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:27 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:27 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-b16141f3-7672-4a51-8d5a-8152f2c91332-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-b16141f3-7672-4a51-8d5a-8152f2c91332-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-quobyte-b16141f3-7672-4a51-8d5a-8152f2c91332" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-b16141f3-7672-4a51-8d5a-8152f2c91332" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cb0f39-5f60-4875-b387-4ef844411332]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:28 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 Jul 09 09:31:28 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:28 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.690s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Deleted volume successfully. Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e8337579-c12d-406d-9af9-16f41455e284 tempest-ProjectReaderTests-744643402 None] Lock "cinder-304875e2-0030-430c-8025-71de044d59a1-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:28 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332" returned: 0 in 0.791s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:28 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332 Jul 09 09:31:28 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:29 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b16141f3-7672-4a51-8d5a-8152f2c91332" returned: 0 in 0.693s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-b16141f3-7672-4a51-8d5a-8152f2c91332" released by "delete_volume" :: held 1.540s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Created reservations ['85238e1c-37d3-449a-bfe5-c652c60a8101', 'ddcb39d5-3f73-4256-a7b1-a047ac615841', 'aece5984-2827-490b-a743-d7d8fa0886fe', 'abe41e9c-9b7a-4fc7-9cd2-03aea595348c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:29 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:29 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:30 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.700s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Deleted volume successfully. Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c7aed118-2a0e-493b-8db4-a4072c331be3 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-b16141f3-7672-4a51-8d5a-8152f2c91332-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (5aae8c74-132d-4eff-abb8-0a72394653cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f55383-47b0-4cfd-80a7-23dcd24c00f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f55383-47b0-4cfd-80a7-23dcd24c00f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-133777292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7640c75-4f5d-4134-9b6f-11dbe7f19c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:31Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1537b9d4-f7f7-42bb-9ef2-d4b6efc123c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1537b9d4-f7f7-42bb-9ef2-d4b6efc123c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a228cb1-6651-453d-81af-f5fb1229f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a228cb1-6651-453d-81af-f5fb1229f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7640c75-4f5d-4134-9b6f-11dbe7f19c53', 'volume_name': 'volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380ece7-27c3-4de6-85df-e811d1ef58c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380ece7-27c3-4de6-85df-e811d1ef58c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebee58e1-97ed-4051-a9ea-f706df06849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:30 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Volume a7640c75-4f5d-4134-9b6f-11dbe7f19c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53', 'volume_size': 1} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-133777292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7640c75-4f5d-4134-9b6f-11dbe7f19c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:31Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Creating volume a7640c75-4f5d-4134-9b6f-11dbe7f19c53 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:30 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:30 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 1073741824 Jul 09 09:31:30 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:31 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 1073741824" returned: 0 in 0.822s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:31 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 Jul 09 09:31:31 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:32 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebee58e1-97ed-4051-a9ea-f706df06849a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3110113-3f37-4759-bb19-17efec51e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:32 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Volume volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 (a7640c75-4f5d-4134-9b6f-11dbe7f19c53): created successfully Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3110113-3f37-4759-bb19-17efec51e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (5aae8c74-132d-4eff-abb8-0a72394653cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:32 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7e5687bb-869b-417e-98c3-fd61a17353c4 tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-a7640c75-4f5d-4134-9b6f-11dbe7f19c53-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-a7640c75-4f5d-4134-9b6f-11dbe7f19c53-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-quobyte-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a4b5d-0513-42fb-9e9b-23cac7ad46a4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:33 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 Jul 09 09:31:33 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:33 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" returned: 0 in 0.742s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:33 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53 Jul 09 09:31:33 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:34 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-a7640c75-4f5d-4134-9b6f-11dbe7f19c53" released by "delete_volume" :: held 1.406s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Created reservations ['67b14ca9-8523-4665-86fd-4333fb791228', '0c357cf4-778f-4012-90af-9c31b2037d71', 'c144d811-3fa0-46f4-9afe-0c11ae4f55f7', 'c9ae5218-2940-4a26-94ac-32c602267c33'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:34 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:34 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:35 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.644s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Deleted volume successfully. Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-39672d51-1346-4bc1-b5d4-bddb662264e1 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-a7640c75-4f5d-4134-9b6f-11dbe7f19c53-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (b6f76358-bc78-4e6a-8f5a-42520ff18a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546c1c5b-54d9-460d-8681-b4be4fcd9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546c1c5b-54d9-460d-8681-b4be4fcd9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188018130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6211f9-d71c-45a4-90af-cac0f4b596e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:36Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f34602-04d0-49d8-8fd5-20fe509befc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f34602-04d0-49d8-8fd5-20fe509befc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8cf487-f7f1-4986-95f5-f1ec74164e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8cf487-f7f1-4986-95f5-f1ec74164e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6211f9-d71c-45a4-90af-cac0f4b596e5', 'volume_name': 'volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7f02e4-ce4b-4dc8-8fd4-bcb5d3212791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7f02e4-ce4b-4dc8-8fd4-bcb5d3212791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8549a46a-30c5-4c14-8d0d-5a5a5241c5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Volume 4a6211f9-d71c-45a4-90af-cac0f4b596e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5', 'volume_size': 1} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188018130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6211f9-d71c-45a4-90af-cac0f4b596e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:36Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Creating volume 4a6211f9-d71c-45a4-90af-cac0f4b596e5 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:35 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:35 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 1073741824 Jul 09 09:31:35 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:36 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 1073741824" returned: 0 in 0.810s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:36 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 Jul 09 09:31:36 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:37 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5" returned: 0 in 0.645s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8549a46a-30c5-4c14-8d0d-5a5a5241c5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85018ef-c288-4d0b-8047-6cf8f472fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Volume volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 (4a6211f9-d71c-45a4-90af-cac0f4b596e5): created successfully Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85018ef-c288-4d0b-8047-6cf8f472fcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (b6f76358-bc78-4e6a-8f5a-42520ff18a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f7706143-304e-4392-98ed-61c4274879a0 tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-4a6211f9-d71c-45a4-90af-cac0f4b596e5-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-4a6211f9-d71c-45a4-90af-cac0f4b596e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-quobyte-4a6211f9-d71c-45a4-90af-cac0f4b596e5" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-4a6211f9-d71c-45a4-90af-cac0f4b596e5" acquired by "delete_volume" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a2881f-5c15-4714-aed6-e794db4429b7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:37 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 Jul 09 09:31:37 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:38 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5" returned: 0 in 0.745s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:38 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5 Jul 09 09:31:38 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:39 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4a6211f9-d71c-45a4-90af-cac0f4b596e5" returned: 0 in 0.629s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-4a6211f9-d71c-45a4-90af-cac0f4b596e5" released by "delete_volume" :: held 1.414s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Created reservations ['40a36be0-acda-4df9-91c2-b07612c86760', '09b5948c-f077-46eb-97ae-a42cf51dec9e', '76e41cf0-0e72-42da-aad1-9bd0cf87a5c2', 'b8c7afee-95f0-4fcc-b4c6-2671267fece2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:39 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:39 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:39 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.648s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Deleted volume successfully. Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c139b8d2-f197-45b0-a378-37c4f3ba2003 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-4a6211f9-d71c-45a4-90af-cac0f4b596e5-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (ff82a504-2568-4ff6-a984-e47ae44a9634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120a470-42df-42a6-86ba-c53ac02cc493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120a470-42df-42a6-86ba-c53ac02cc493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054474048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434434de-5922-4229-a0a3-3fabc340fe5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:40Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2d4026-2514-4e45-8b52-aed3ddacd0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2d4026-2514-4e45-8b52-aed3ddacd0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2889fd1b-4c3f-4947-97b5-56c0fb00e696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2889fd1b-4c3f-4947-97b5-56c0fb00e696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434434de-5922-4229-a0a3-3fabc340fe5a', 'volume_name': 'volume-434434de-5922-4229-a0a3-3fabc340fe5a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a91d63-6ba8-4603-9dda-913a55cbe1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a91d63-6ba8-4603-9dda-913a55cbe1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ceb468-3716-4d8a-bb8c-4f40bdb1153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Volume 434434de-5922-4229-a0a3-3fabc340fe5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434434de-5922-4229-a0a3-3fabc340fe5a', 'volume_size': 1} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054474048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434434de-5922-4229-a0a3-3fabc340fe5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:40Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Creating volume 434434de-5922-4229-a0a3-3fabc340fe5a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:40 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:40 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a 1073741824 Jul 09 09:31:40 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:41 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a 1073741824" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=105,cinder:UPDATE=162,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:31:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=105,cinder:INSERT=36,cinder:UPDATE=143,cinder:DELETE=13 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:31:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:41 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a Jul 09 09:31:41 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:42 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a" returned: 0 in 0.651s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ceb468-3716-4d8a-bb8c-4f40bdb1153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434434de-5922-4229-a0a3-3fabc340fe5a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb957f8-712c-47ef-a608-850c7c7fa0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Volume volume-434434de-5922-4229-a0a3-3fabc340fe5a (434434de-5922-4229-a0a3-3fabc340fe5a): created successfully Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb957f8-712c-47ef-a608-850c7c7fa0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (ff82a504-2568-4ff6-a984-e47ae44a9634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-dd2ef35c-8718-4856-a737-a9dfe211422a tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-434434de-5922-4229-a0a3-3fabc340fe5a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-434434de-5922-4229-a0a3-3fabc340fe5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "cinder-quobyte-434434de-5922-4229-a0a3-3fabc340fe5a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-434434de-5922-4229-a0a3-3fabc340fe5a" acquired by "delete_volume" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac1bd40-8ec9-4563-bdd4-b1ee7848a05f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:42 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a Jul 09 09:31:42 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:43 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a" returned: 0 in 0.739s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:43 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a Jul 09 09:31:43 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:44 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-434434de-5922-4229-a0a3-3fabc340fe5a" returned: 0 in 0.643s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-quobyte-434434de-5922-4229-a0a3-3fabc340fe5a" released by "delete_volume" :: held 1.420s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Created reservations ['77095feb-a4a2-4400-b224-9ba0c09783b1', '6689eac0-26c9-40a0-a5aa-379f9f4641d6', '0a0770aa-da48-4bda-a251-a84d40f3471c', '302ee539-c81b-47df-89a7-086dde802e52'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:44 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:44 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:44 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.654s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Deleted volume successfully. Jul 09 09:31:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0b8fcb21-6a4b-4250-b742-e16cbd7cdd69 tempest-VolumesActionsTest-1514984552 None] Lock "cinder-434434de-5922-4229-a0a3-3fabc340fe5a-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (b88422cd-aea9-4b00-b353-2e7eba78ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98f42cf-c26b-4538-b2da-ee23d224e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98f42cf-c26b-4538-b2da-ee23d224e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698431309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89572165-7520-4c12-82ab-4312186600bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:45Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee944eaa-2100-486b-a348-0140859a877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee944eaa-2100-486b-a348-0140859a877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5f556c-c94e-4a07-a146-6d881aa5fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5f556c-c94e-4a07-a146-6d881aa5fb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89572165-7520-4c12-82ab-4312186600bc', 'volume_name': 'volume-89572165-7520-4c12-82ab-4312186600bc', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4edd31-8a7b-4e28-970f-b44cb0ad3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4edd31-8a7b-4e28-970f-b44cb0ad3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1b5867-4cc4-4491-b4af-add48b5cc8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:45 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Volume 89572165-7520-4c12-82ab-4312186600bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89572165-7520-4c12-82ab-4312186600bc', 'volume_size': 1} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698431309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89572165-7520-4c12-82ab-4312186600bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bd6fbc639f484cbaeb87100d44283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:31:45Z,use_quota=True,user_id='426cfdbe4baf4001bac3d9ca939545a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Creating volume 89572165-7520-4c12-82ab-4312186600bc {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:31:45 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:31:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:45 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc 1073741824 Jul 09 09:31:45 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:46 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc 1073741824" returned: 0 in 0.813s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:46 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc Jul 09 09:31:46 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:46 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc" returned: 0 in 0.637s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1b5867-4cc4-4491-b4af-add48b5cc8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89572165-7520-4c12-82ab-4312186600bc', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b85163-a350-47de-b6c1-9f93ab8de4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:31:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Volume volume-89572165-7520-4c12-82ab-4312186600bc (89572165-7520-4c12-82ab-4312186600bc): created successfully Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b85163-a350-47de-b6c1-9f93ab8de4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:31:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Flow 'volume_create_manager' (b88422cd-aea9-4b00-b353-2e7eba78ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:31:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f58473bd-17fa-4254-af3b-77358cef51d5 tempest-VolumesActionsTest-1505409356 None] Created volume successfully. Jul 09 09:31:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-89572165-7520-4c12-82ab-4312186600bc-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-89572165-7520-4c12-82ab-4312186600bc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "cinder-quobyte-89572165-7520-4c12-82ab-4312186600bc" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:31:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-quobyte-89572165-7520-4c12-82ab-4312186600bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:31:48 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8edf82b-f144-454d-9fd3-0028bcb54a14]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:31:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:48 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc Jul 09 09:31:48 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:48 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc" returned: 0 in 0.760s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:48 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc Jul 09 09:31:48 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:49 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-89572165-7520-4c12-82ab-4312186600bc" returned: 0 in 0.679s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-quobyte-89572165-7520-4c12-82ab-4312186600bc" released by "delete_volume" :: held 1.476s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Created reservations ['4d870b19-74db-4bee-8a3f-03b92b8e638e', 'deb93423-14cc-4505-a706-61200ef3bb57', '27f00d08-527b-415c-b0cd-f1533167e7ad', '201cc684-3713-45e3-a7ac-027439bb291d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:49 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:49 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:50 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.655s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Deleted volume successfully. Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-53abfb57-cba7-485a-ba41-64ca29fd1c37 tempest-VolumesActionsTest-1505409356 None] Lock "cinder-89572165-7520-4c12-82ab-4312186600bc-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:31:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:31:50 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:31:50 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:31:51 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jul 09 09:31:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:31:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:31:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:31:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:31:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:31:59 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=24,cinder:SELECT=14,cinder:INSERT=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:32:00 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Flow 'volume_create_manager' (55843d68-954a-4a79-874f-8f0707b0c1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204c6a1c-ce1a-437a-91c2-88abf7b8dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204c6a1c-ce1a-437a-91c2-88abf7b8dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1272575930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e211f-6c1d-49d5-8257-a7ae510f2210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf5cd6dab914a16b255813d473f72e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:05Z,use_quota=True,user_id='1dad3647f2924919bbb104382485210e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7839b815-daa6-44c0-b0ef-1cddf5a03f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7839b815-daa6-44c0-b0ef-1cddf5a03f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2396f1-81a8-46e4-aec7-efdc7e7ef901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2396f1-81a8-46e4-aec7-efdc7e7ef901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518e211f-6c1d-49d5-8257-a7ae510f2210', 'volume_name': 'volume-518e211f-6c1d-49d5-8257-a7ae510f2210', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fe8496-2b75-475d-9114-c611692f009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fe8496-2b75-475d-9114-c611692f009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41167b2-aee2-4bc9-8b76-a876d6548b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:05 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Volume 518e211f-6c1d-49d5-8257-a7ae510f2210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518e211f-6c1d-49d5-8257-a7ae510f2210', 'volume_size': 1} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1272575930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e211f-6c1d-49d5-8257-a7ae510f2210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf5cd6dab914a16b255813d473f72e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:05Z,use_quota=True,user_id='1dad3647f2924919bbb104382485210e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Creating volume 518e211f-6c1d-49d5-8257-a7ae510f2210 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:32:05 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:05 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 1073741824 Jul 09 09:32:05 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:05 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 1073741824" returned: 0 in 0.804s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:06 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 Jul 09 09:32:06 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:06 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41167b2-aee2-4bc9-8b76-a876d6548b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518e211f-6c1d-49d5-8257-a7ae510f2210', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f064ac-397f-4b89-8fe6-49e63c18cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:06 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Volume volume-518e211f-6c1d-49d5-8257-a7ae510f2210 (518e211f-6c1d-49d5-8257-a7ae510f2210): created successfully Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f064ac-397f-4b89-8fe6-49e63c18cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Flow 'volume_create_manager' (55843d68-954a-4a79-874f-8f0707b0c1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-298511f5-4b30-437e-9046-3c78d0981b44 tempest-VolumesTransfersV357Test-1319899693 None] Created volume successfully. Jul 09 09:32:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8c80e393-6857-46e7-b0ca-4498f64b49de tempest-VolumesTransfersV357Test-950402916 None] Transfer volume completed successfully. Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "cinder-518e211f-6c1d-49d5-8257-a7ae510f2210-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-518e211f-6c1d-49d5-8257-a7ae510f2210-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "cinder-quobyte-518e211f-6c1d-49d5-8257-a7ae510f2210" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-quobyte-518e211f-6c1d-49d5-8257-a7ae510f2210" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[14efc81f-ac0a-4945-8155-39e3c23efe04]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:32:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:08 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 Jul 09 09:32:08 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:09 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210" returned: 0 in 0.745s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:09 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210 Jul 09 09:32:09 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:10 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-518e211f-6c1d-49d5-8257-a7ae510f2210" returned: 0 in 0.638s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-quobyte-518e211f-6c1d-49d5-8257-a7ae510f2210" released by "delete_volume" :: held 1.423s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Created reservations ['bca9aa4f-eb66-4dc3-b6a0-cdc5b3a33086', '3050d0cd-fcfa-4652-bbdf-a221db4ef9c1', '49b68f97-f338-401a-a615-14be17fe0412', '633d8f15-f896-41bf-9b08-7dbd241473ff'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:10 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:32:10 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:10 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:32:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Deleted volume successfully. Jul 09 09:32:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9064e031-9115-429f-ba11-2707fbc753fc tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-518e211f-6c1d-49d5-8257-a7ae510f2210-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Flow 'volume_create_manager' (4677c925-6b91-42c3-9aee-7d36cd6d40be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088bd60f-f8e8-4ae4-bf65-dd1645be5531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088bd60f-f8e8-4ae4-bf65-dd1645be5531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-762236270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b68e202-ef28-4bac-b508-813158ee7355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf5cd6dab914a16b255813d473f72e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:11Z,use_quota=True,user_id='1dad3647f2924919bbb104382485210e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153a76b7-434c-4b5c-93d7-6578016ab4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153a76b7-434c-4b5c-93d7-6578016ab4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b0c92c-a5a4-46dd-8de6-9979b21df95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b0c92c-a5a4-46dd-8de6-9979b21df95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b68e202-ef28-4bac-b508-813158ee7355', 'volume_name': 'volume-9b68e202-ef28-4bac-b508-813158ee7355', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e927f1-1db2-4771-9eca-ae52ad26411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e927f1-1db2-4771-9eca-ae52ad26411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442beb9-dc29-4173-a2bc-bc39b1878e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:11 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Volume 9b68e202-ef28-4bac-b508-813158ee7355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b68e202-ef28-4bac-b508-813158ee7355', 'volume_size': 1} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-762236270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b68e202-ef28-4bac-b508-813158ee7355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf5cd6dab914a16b255813d473f72e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:11Z,use_quota=True,user_id='1dad3647f2924919bbb104382485210e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Creating volume 9b68e202-ef28-4bac-b508-813158ee7355 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:32:11 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:32:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:11 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 1073741824 Jul 09 09:32:11 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:12 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 1073741824" returned: 0 in 0.809s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:12 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 Jul 09 09:32:12 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:12 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442beb9-dc29-4173-a2bc-bc39b1878e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b68e202-ef28-4bac-b508-813158ee7355', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2821d701-bc73-4a17-b5f4-61a6f6460dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Volume volume-9b68e202-ef28-4bac-b508-813158ee7355 (9b68e202-ef28-4bac-b508-813158ee7355): created successfully Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2821d701-bc73-4a17-b5f4-61a6f6460dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Flow 'volume_create_manager' (4677c925-6b91-42c3-9aee-7d36cd6d40be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f3f6a2ed-64fd-4c79-8d95-78581edd5674 tempest-VolumesTransfersV357Test-1319899693 None] Created volume successfully. Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "cinder-9b68e202-ef28-4bac-b508-813158ee7355-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-9b68e202-ef28-4bac-b508-813158ee7355-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "cinder-quobyte-9b68e202-ef28-4bac-b508-813158ee7355" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-quobyte-9b68e202-ef28-4bac-b508-813158ee7355" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f5ede-c9fb-4906-bcf5-4ed1061e703b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:32:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:13 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 Jul 09 09:32:13 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:14 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355" returned: 0 in 0.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:14 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355 Jul 09 09:32:14 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:14 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9b68e202-ef28-4bac-b508-813158ee7355" returned: 0 in 0.628s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-quobyte-9b68e202-ef28-4bac-b508-813158ee7355" released by "delete_volume" :: held 1.400s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Created reservations ['ddcfa1f3-a16d-4f39-89e5-1dde6de2d724', 'd93aaac2-4e2f-4ab7-8254-2b32ca5c4a08', '2f6e261c-eaec-43c1-8390-8e3e3fad888f', '188f82b8-a3f8-4df1-83c4-75edaa262f1c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:15 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:32:15 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:15 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.624s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:32:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Deleted volume successfully. Jul 09 09:32:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b76771b3-8234-4002-9bcb-01fe86863441 tempest-VolumesTransfersV357Test-603691205 None] Lock "cinder-9b68e202-ef28-4bac-b508-813158ee7355-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Flow 'volume_create_manager' (c9d30a24-4efc-4fc0-b9a3-054dbbaf55ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa826175-97e5-4b59-b8ec-4b2a44c9ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa826175-97e5-4b59-b8ec-4b2a44c9ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1106153222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc01709-0e57-40d4-afc3-e7836116d1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e225c4920a41df9600fa7d743948bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:21Z,use_quota=True,user_id='be980dda4b954722ab9f59fcdfc499e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b626158c-87e1-423f-ab56-8928cf53023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b626158c-87e1-423f-ab56-8928cf53023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f367147d-6365-4b09-a15c-a7d8582d2f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f367147d-6365-4b09-a15c-a7d8582d2f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc01709-0e57-40d4-afc3-e7836116d1fd', 'volume_name': 'volume-adc01709-0e57-40d4-afc3-e7836116d1fd', 'volume_size': 2}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d73b6-7ee6-4cea-9411-e4544f97589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d73b6-7ee6-4cea-9411-e4544f97589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dd18cb-5b36-4f3d-a526-d5634c58c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Volume adc01709-0e57-40d4-afc3-e7836116d1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc01709-0e57-40d4-afc3-e7836116d1fd', 'volume_size': 2} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1106153222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc01709-0e57-40d4-afc3-e7836116d1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e225c4920a41df9600fa7d743948bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:32:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:32:21Z,use_quota=True,user_id='be980dda4b954722ab9f59fcdfc499e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Creating volume adc01709-0e57-40d4-afc3-e7836116d1fd {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:32:20 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:32:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd 2147483648 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:20 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd 2147483648 Jul 09 09:32:20 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:21 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd 2147483648" returned: 0 in 0.877s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:21 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd Jul 09 09:32:21 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:22 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dd18cb-5b36-4f3d-a526-d5634c58c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc01709-0e57-40d4-afc3-e7836116d1fd', 'volume_size': 2}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9792cbaf-d274-40a3-a9f6-831e3a0db18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:32:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Volume volume-adc01709-0e57-40d4-afc3-e7836116d1fd (adc01709-0e57-40d4-afc3-e7836116d1fd): created successfully Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9792cbaf-d274-40a3-a9f6-831e3a0db18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Flow 'volume_create_manager' (c9d30a24-4efc-4fc0-b9a3-054dbbaf55ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:32:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6525f90b-f111-432a-962f-c1c864eec0b9 tempest-VolumesCloneNegativeTest-1889851896 None] Created volume successfully. Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Acquiring lock "cinder-adc01709-0e57-40d4-afc3-e7836116d1fd-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "cinder-adc01709-0e57-40d4-afc3-e7836116d1fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Acquiring lock "cinder-quobyte-adc01709-0e57-40d4-afc3-e7836116d1fd" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "cinder-quobyte-adc01709-0e57-40d4-afc3-e7836116d1fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e4b975-b8ac-4981-858a-9209cf166e20]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:23 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd Jul 09 09:32:23 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:23 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd" returned: 0 in 0.761s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:23 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd Jul 09 09:32:23 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:24 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-adc01709-0e57-40d4-afc3-e7836116d1fd" returned: 0 in 0.652s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "cinder-quobyte-adc01709-0e57-40d4-afc3-e7836116d1fd" released by "delete_volume" :: held 1.452s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Created reservations ['6ecdd498-ea8f-4954-94a0-3d0c0988a198', '1d95bd38-1c3c-4393-8b65-498242f6242b', 'e6778994-c634-453e-aba2-ed53e6e4eb6f', '1945ec86-f601-41d0-9e0f-8e88dc79aeb4'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:24 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:32:24 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:25 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:25 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:32:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Deleted volume successfully. Jul 09 09:32:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0481f4fd-0a31-4ba6-a74f-ab946336e9c9 tempest-VolumesCloneNegativeTest-1889851896 None] Lock "cinder-adc01709-0e57-40d4-afc3-e7836116d1fd-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:32:34 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:32:35 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:32:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:32:50 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:32:50 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:32:51 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 09 09:32:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:32:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:32:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:32:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:32:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:33:25 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Flow 'volume_create_manager' (86c1fc9b-0520-4a53-8bf0-94ad35a95dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58585ab-a442-4661-ba2a-f147f3edc82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58585ab-a442-4661-ba2a-f147f3edc82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1741524177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9e4916-cc20-4821-be12-44f5e03a2023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba7af1fa46d4c86915275171c5a475c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:33:26Z,use_quota=True,user_id='8d6cdaf597bc456f825f53682739b961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae024200-2062-49bf-bbc0-26798f2cdc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae024200-2062-49bf-bbc0-26798f2cdc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cbf21e-951a-4742-9703-2d0e2627649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cbf21e-951a-4742-9703-2d0e2627649e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9e4916-cc20-4821-be12-44f5e03a2023', 'volume_name': 'volume-8b9e4916-cc20-4821-be12-44f5e03a2023', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5df9b56-1dce-4060-b090-6f203f600fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5df9b56-1dce-4060-b090-6f203f600fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d722a31-6cf7-4781-b5ec-e61b86c9274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Volume 8b9e4916-cc20-4821-be12-44f5e03a2023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9e4916-cc20-4821-be12-44f5e03a2023', 'volume_size': 1} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1741524177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9e4916-cc20-4821-be12-44f5e03a2023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba7af1fa46d4c86915275171c5a475c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:33:26Z,use_quota=True,user_id='8d6cdaf597bc456f825f53682739b961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Creating volume 8b9e4916-cc20-4821-be12-44f5e03a2023 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:33:26 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:26 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 1073741824 Jul 09 09:33:26 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:26 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 1073741824" returned: 0 in 0.820s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:26 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 Jul 09 09:33:26 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:27 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023" returned: 0 in 0.649s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d722a31-6cf7-4781-b5ec-e61b86c9274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9e4916-cc20-4821-be12-44f5e03a2023', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e27ac56-a62e-4ed6-8dc1-f910a90b2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:33:27 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Volume volume-8b9e4916-cc20-4821-be12-44f5e03a2023 (8b9e4916-cc20-4821-be12-44f5e03a2023): created successfully Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e27ac56-a62e-4ed6-8dc1-f910a90b2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:33:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Flow 'volume_create_manager' (86c1fc9b-0520-4a53-8bf0-94ad35a95dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:33:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3c1d7313-a70c-4230-8efe-a9d7b947c3d6 tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Created volume successfully. Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea524c02-749e-4f0a-be36-9eadd8489d51]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:31 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 Jul 09 09:33:31 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:31 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023" returned: 0 in 0.776s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:33:32 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-8b9e4916-cc20-4821-be12-44f5e03a2023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa58fe64-162a-4b7f-8027-453e7b553168', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:33:32 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-8af2a34e-8b8a-4cc0-9999-fb5f7239dc48 req-a2065c45-b2b9-4c6d-a85d-8b7cd7760bcb tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] attachment_update completed successfully. Jul 09 09:33:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-87cd64ee-6ea2-4384-a38a-7ab63905a4a7 req-1d9ef20a-3de2-448c-b8b3-378594da95ac tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Terminate volume connection completed successfully. Jul 09 09:33:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-87cd64ee-6ea2-4384-a38a-7ab63905a4a7 req-1d9ef20a-3de2-448c-b8b3-378594da95ac tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Deleting attachment fa58fe64-162a-4b7f-8027-453e7b553168. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "cinder-8b9e4916-cc20-4821-be12-44f5e03a2023-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "cinder-8b9e4916-cc20-4821-be12-44f5e03a2023-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "cinder-quobyte-8b9e4916-cc20-4821-be12-44f5e03a2023" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "cinder-quobyte-8b9e4916-cc20-4821-be12-44f5e03a2023" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7269060d-0a16-4446-a6f9-3afc117416e1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:40 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 Jul 09 09:33:40 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:40 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:40 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023 Jul 09 09:33:40 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:41 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b9e4916-cc20-4821-be12-44f5e03a2023" returned: 0 in 0.685s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "cinder-quobyte-8b9e4916-cc20-4821-be12-44f5e03a2023" released by "delete_volume" :: held 1.454s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Created reservations ['20dd6b33-39bd-4585-831c-9d856c9bcead', '19cede6d-0352-45df-a941-c56070cc0fc5', 'e7ad34c8-2b88-49ac-89da-433367314394', 'ce44ffd1-75b7-4d56-8bd3-87b9103fc166'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:33:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:41 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:33:41 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:42 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.658s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:33:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Deleted volume successfully. Jul 09 09:33:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-81942d25-c126-486f-b650-288fe34dc3bc tempest-TestServerVolumeAttachScenarioOldVersion-1994013471 None] Lock "cinder-8b9e4916-cc20-4821-be12-44f5e03a2023-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:33:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:33:50 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:33:50 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:33:51 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.696s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:33:51 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:33:52 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=13,cinder:SELECT=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Flow 'volume_create_manager' (e1fa2bd9-361c-4101-8ad7-a0d94c7c5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1060f4a-a00c-4360-a605-aebc096e7736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1060f4a-a00c-4360-a605-aebc096e7736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1315782975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e1624c-861e-40e7-90f0-d187ca04ab0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6737aa901b574a4488c957bbb12b3596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:34:21Z,use_quota=True,user_id='da98f9a0ab4b448bb017876caf2bbff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc3303-f92c-46c0-bf33-1f2f8fe681fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc3303-f92c-46c0-bf33-1f2f8fe681fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e9e415-53a9-44b0-8fe8-1d8adbb89769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:20 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e9e415-53a9-44b0-8fe8-1d8adbb89769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'volume_name': 'volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e941db3-34e6-4f2e-b053-349e072d690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e941db3-34e6-4f2e-b053-349e072d690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48755ba-9f7a-4ed1-a7f3-4d3ceb1eaa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Volume b0e1624c-861e-40e7-90f0-d187ca04ab0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Trying to clone b0e1624c-861e-40e7-90f0-d187ca04ab0a from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:34:21 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Image download 20.69 MB at 20.69 MB/s Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a90950-df4c-4323-b509-5e38cd8da3c0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:21 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD Jul 09 09:34:21 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:22 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:22 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 is fetched for user da98f9a0ab4b448bb017876caf2bbff2. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:34:22 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c3531-dc9e-466a-bd2c-783cee221980]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:22 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD Jul 09 09:34:22 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:23 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1315782975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e1624c-861e-40e7-90f0-d187ca04ab0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6737aa901b574a4488c957bbb12b3596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:34:21Z,use_quota=True,user_id='da98f9a0ab4b448bb017876caf2bbff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Creating volume b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:34:23 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:23 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1073741824 Jul 09 09:34:23 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:23 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1073741824" returned: 0 in 0.808s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:23 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:23 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:24 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.621s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Attempting download of 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume b0e1624c-861e-40e7-90f0-d187ca04ab0a. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b0d0b8-eadb-4f0a-b5e0-907375c42a4a]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:24 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av Jul 09 09:34:24 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:25 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av" returned: 0 in 0.723s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:25 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av Jul 09 09:34:25 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:26 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av" returned: 1 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c391f23-175f-4461-b6ef-8981ab0baaf6_galb84av' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b83b69-36d2-4515-84ed-a06356b04183]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:26 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD Jul 09 09:34:26 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:26 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] 7c391f23-175f-4461-b6ef-8981ab0baaf6 was qcow2, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:34:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:26 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:26 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:28 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 1.715s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:28 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c391f23-175f-4461-b6ef-8981ab0baaf6_bpqsdib_devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:34:28 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Converted 112.00 MB image at 65.25 MB/s Jul 09 09:34:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:28 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1G Jul 09 09:34:28 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:29 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a 1G" returned: 0 in 0.662s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[62201db3-5766-4a71-92a5-78d624167495]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:29 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:29 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:29 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.718s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:29 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:29 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:30 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 1 in 0.707s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Downloaded image 7c391f23-175f-4461-b6ef-8981ab0baaf6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}])) to volume b0e1624c-861e-40e7-90f0-d187ca04ab0a successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Temporary image 7c391f23-175f-4461-b6ef-8981ab0baaf6 for user da98f9a0ab4b448bb017876caf2bbff2 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Marking volume b0e1624c-861e-40e7-90f0-d187ca04ab0a as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Copying metadata from image 7c391f23-175f-4461-b6ef-8981ab0baaf6 to b0e1624c-861e-40e7-90f0-d187ca04ab0a. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Creating volume glance metadata for volume b0e1624c-861e-40e7-90f0-d187ca04ab0a backed by image 7c391f23-175f-4461-b6ef-8981ab0baaf6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48755ba-9f7a-4ed1-a7f3-4d3ceb1eaa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'volume_size': 1, 'image_id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c391f23-175f-4461-b6ef-8981ab0baaf6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8783f14ef82400d90e5721bd31d78c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c391f23-175f-4461-b6ef-8981ab0baaf6', 'created_at': datetime.datetime(2026, 7, 9, 7, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 9, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c391f23-175f-4461-b6ef-8981ab0baaf6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fe9aa2-29ca-4697-9cbd-970b742414ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:34:30 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Volume volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a (b0e1624c-861e-40e7-90f0-d187ca04ab0a): created successfully Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fe9aa2-29ca-4697-9cbd-970b742414ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:34:30 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Flow 'volume_create_manager' (e1fa2bd9-361c-4101-8ad7-a0d94c7c5f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:34:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ca4dc694-94cb-45c2-9097-2229154bcd69 tempest-TestShelveInstance-1232400874 None] Created volume successfully. Jul 09 09:34:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:34:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:34:38 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479ef10-327c-4769-b376-e8706bc0a15a]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:34:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:38 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:38 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:39 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.766s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:39 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:34:39 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:39 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 1 in 0.713s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.525s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:34:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c79038dd-1cb5-497f-8583-88540b7517e7', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:34:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-81b3af97-3b6a-4921-a442-68a670005995 req-95af1e21-9e67-4af1-a1c6-6fe6e9ada58e tempest-TestShelveInstance-1232400874 None] attachment_update completed successfully. Jul 09 09:34:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:34:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=5,cinder:SELECT=13,cinder:INSERT=7 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:34:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:34:50 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:34:50 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:34:51 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 09 09:34:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:34:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:34:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:34:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:34:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:35:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-6c7d5e9a-646b-4b97-84f7-8b9d7a866e0d req-d94850c0-326b-4faf-8daa-9695545f4fbb tempest-TestShelveInstance-1232400874 None] Terminate volume connection completed successfully. Jul 09 09:35:16 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-6c7d5e9a-646b-4b97-84f7-8b9d7a866e0d req-d94850c0-326b-4faf-8daa-9695545f4fbb tempest-TestShelveInstance-1232400874 None] Deleting attachment c79038dd-1cb5-497f-8583-88540b7517e7. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2069b90-ee25-4591-9db6-e126c4f8eb14]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:35:21 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:35:21 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:35:21 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:35:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:35:21 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:35:21 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:35:22 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 09 09:35:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 1 in 0.715s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:35:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:35:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.492s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:35:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2982ec1e-837d-4b63-bead-e9643e37ddc1', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:35:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-bfe82484-5217-4b96-966f-0cc84d242cea req-97eb1725-b73a-48e9-ba83-26a31c46b94e tempest-TestShelveInstance-1232400874 None] attachment_update completed successfully. Jul 09 09:35:32 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:35:32 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:35:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:35:50 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:35:50 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:35:51 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 09 09:35:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:35:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:35:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:35:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:35:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:36:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-70dcbb18-af26-4a6c-b339-21e74c09b2df tempest-TestShelveInstance-1232400874 None] Terminate volume connection completed successfully. Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-70dcbb18-af26-4a6c-b339-21e74c09b2df tempest-TestShelveInstance-1232400874 None] Deleting attachment 2982ec1e-837d-4b63-bead-e9643e37ddc1. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Acquiring lock "cinder-b0e1624c-861e-40e7-90f0-d187ca04ab0a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "cinder-b0e1624c-861e-40e7-90f0-d187ca04ab0a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Acquiring lock "cinder-quobyte-b0e1624c-861e-40e7-90f0-d187ca04ab0a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "cinder-quobyte-b0e1624c-861e-40e7-90f0-d187ca04ab0a" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[08493808-4858-4f6c-9ec2-fed746543d33]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:36:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:01 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:36:01 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:01 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.759s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:01 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:36:01 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:02 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 1 in 0.767s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:36:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:02 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a Jul 09 09:36:02 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:03 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b0e1624c-861e-40e7-90f0-d187ca04ab0a" returned: 0 in 0.682s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "cinder-quobyte-b0e1624c-861e-40e7-90f0-d187ca04ab0a" released by "delete_volume" :: held 2.272s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.quota [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Created reservations ['dd4cccda-7839-4b20-a0ca-fc1def51b5c4', 'e9424e74-7866-4c9e-9896-e1dec333d517', 'b7a87768-6ccb-4fcc-b78f-b371643e0f45', 'a31a0af7-45af-4f6d-ad05-797c320f6ac7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:03 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:36:03 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:03 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.manager [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:36:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Deleted volume successfully. Jul 09 09:36:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [req-ad6f7478-c96f-4a8f-9afd-e91db92326fb req-c46ce897-6717-4fb8-90a2-ec967fa65866 tempest-TestShelveInstance-1232400874 None] Lock "cinder-b0e1624c-861e-40e7-90f0-d187ca04ab0a-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:36:13 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:13 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Flow 'volume_create_manager' (cabba17a-2afc-4c7e-abab-19f6ea1a2e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e846d3e4-2db6-4bab-9ca5-5110154b48c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e846d3e4-2db6-4bab-9ca5-5110154b48c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-230386569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d432317-2d75-48b1-ad77-6dcb9d58b2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953430106d44279962a82cb21856099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:36:35Z,use_quota=True,user_id='6b6eb5d1f4b141bb8aa44f4d2264cc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6526e294-6731-4f41-b5ea-ce6a19ceb46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6526e294-6731-4f41-b5ea-ce6a19ceb46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacfe57-b189-4f63-8f3c-6632923a1295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacfe57-b189-4f63-8f3c-6632923a1295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d432317-2d75-48b1-ad77-6dcb9d58b2de', 'volume_name': 'volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675251e7-9f04-431c-86f1-6a377daecc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675251e7-9f04-431c-86f1-6a377daecc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe2c0cf-d8d1-40ce-9aec-fccad9f96038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Volume 4d432317-2d75-48b1-ad77-6dcb9d58b2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de', 'volume_size': 1} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-230386569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d432317-2d75-48b1-ad77-6dcb9d58b2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953430106d44279962a82cb21856099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:36:35Z,use_quota=True,user_id='6b6eb5d1f4b141bb8aa44f4d2264cc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Creating volume 4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:36:35 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:36:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:35 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de 1073741824 Jul 09 09:36:35 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:36 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de 1073741824" returned: 0 in 0.889s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:36 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:36:36 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:36 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.676s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe2c0cf-d8d1-40ce-9aec-fccad9f96038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ccd1fa-bada-4118-9ea1-270c08223569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:36:36 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Volume volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de (4d432317-2d75-48b1-ad77-6dcb9d58b2de): created successfully Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ccd1fa-bada-4118-9ea1-270c08223569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:36:36 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Flow 'volume_create_manager' (cabba17a-2afc-4c7e-abab-19f6ea1a2e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:36:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23e56f7c-a4ea-4ace-b2af-eed7000729ec tempest-TestStampPattern-1412773965 None] Created volume successfully. Jul 09 09:36:46 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:46 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:36:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:36:50 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:36:50 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:36:51 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 09 09:36:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.689s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:36:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:36:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:36:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:36:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[39397e50-e273-402c-86f6-7ecdcf953a66]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:15 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:37:15 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:15 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea9c70fe-941b-404a-a1a6-f539e6a9f124', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:37:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-ad95daa6-82bd-4d7b-b029-293fdbb20feb req-509e6ab8-deb6-4b99-bf94-13f9a0c3bd02 tempest-TestStampPattern-1412773965 None] attachment_update completed successfully. Jul 09 09:37:23 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-2db99259-e783-4328-a5b3-2edc14c4212a req-b3d1638f-b22c-4420-a267-2a16af903f7e tempest-TestStampPattern-1412773965 None] Terminate volume connection completed successfully. Jul 09 09:37:23 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-2db99259-e783-4328-a5b3-2edc14c4212a req-b3d1638f-b22c-4420-a267-2a16af903f7e tempest-TestStampPattern-1412773965 None] Deleting attachment ea9c70fe-941b-404a-a1a6-f539e6a9f124. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:37:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Creating offline snapshot 7c13a30e-524c-42f4-b6ce-ca2ce014d486 of volume 4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:37:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5be2e5-e805-4272-82c6-fd88a44b0868]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:37:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:26 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:37:26 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:26 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.768s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:26 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 1G Jul 09 09:37:26 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:27 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 1G" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:27 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:37:27 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:28 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:28 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 is being set with open permissions: ugo+rw Jul 09 09:37:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:28 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:37:28 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:28 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:29 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info Jul 09 09:37:29 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:29 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:29 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info is being set with open permissions: ugo+rw Jul 09 09:37:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:29 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info Jul 09 09:37:29 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:30 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.info" returned: 0 in 0.635s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.285s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c4c7c702-ace9-4f48-bda4-de7e2d304d36 tempest-TestStampPattern-1412773965 None] Create snapshot completed successfully Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Flow 'volume_create_manager' (e86e1287-f510-4a16-9464-04695f42daeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a1c108-ce2b-4320-aa3a-17a5c1adde3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a1c108-ce2b-4320-aa3a-17a5c1adde3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1946415489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dafe28-4041-4304-81fb-147fee363e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953430106d44279962a82cb21856099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c13a30e-524c-42f4-b6ce-ca2ce014d486,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:37:41Z,use_quota=True,user_id='6b6eb5d1f4b141bb8aa44f4d2264cc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b5232-7e7f-4bcf-8a7b-35ee43bd013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42b5232-7e7f-4bcf-8a7b-35ee43bd013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ad741c-532d-46b2-97a4-298f411ed144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ad741c-532d-46b2-97a4-298f411ed144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32dafe28-4041-4304-81fb-147fee363e5d', 'volume_name': 'volume-32dafe28-4041-4304-81fb-147fee363e5d', 'volume_size': 1, 'snapshot_id': '7c13a30e-524c-42f4-b6ce-ca2ce014d486'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30234ea-9a2a-41c3-9ae1-b09597102e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30234ea-9a2a-41c3-9ae1-b09597102e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80e8cea-352f-4312-9b6d-c448a7e494e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Volume 32dafe28-4041-4304-81fb-147fee363e5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32dafe28-4041-4304-81fb-147fee363e5d', 'volume_size': 1, 'snapshot_id': '7c13a30e-524c-42f4-b6ce-ca2ce014d486'} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486-32dafe28-4041-4304-81fb-147fee363e5d" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486-32dafe28-4041-4304-81fb-147fee363e5d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Creating volume 32dafe28-4041-4304-81fb-147fee363e5d from snapshot 7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] snapshot: 7c13a30e-524c-42f4-b6ce-ca2ce014d486, volume: 32dafe28-4041-4304-81fb-147fee363e5d, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e27d34-edc7-46f4-83d3-ea705250dde8]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:37:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:41 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:37:41 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:41 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.815s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[004eb477-3bb3-4126-be57-26f38c29c60a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:37:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:41 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:37:41 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:42 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:42 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:37:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:42 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d Jul 09 09:37:42 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:47 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d" returned: 0 in 4.833s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:47 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd6750-ecf0-462a-a645-bc8058f29281]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:37:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:47 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:37:47 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:48 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 1.093s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:48 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:37:48 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Converted 1024.00 MB image at 211.81 MB/s Jul 09 09:37:48 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d is being set with open permissions: ugo+rw Jul 09 09:37:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:48 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d Jul 09 09:37:48 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:49 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d" returned: 0 in 0.732s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" released by "_copy_volume_from_snapshot" :: held 8.308s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486-32dafe28-4041-4304-81fb-147fee363e5d" released by "_create_volume_from_snapshot" :: held 8.340s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.355s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80e8cea-352f-4312-9b6d-c448a7e494e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32dafe28-4041-4304-81fb-147fee363e5d', 'volume_size': 1, 'snapshot_id': '7c13a30e-524c-42f4-b6ce-ca2ce014d486'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dcfe92-0a61-40b0-8103-ea7b101ab8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:37:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Volume volume-32dafe28-4041-4304-81fb-147fee363e5d (32dafe28-4041-4304-81fb-147fee363e5d): created successfully Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dcfe92-0a61-40b0-8103-ea7b101ab8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:37:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Flow 'volume_create_manager' (e86e1287-f510-4a16-9464-04695f42daeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:37:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1b0ffb94-e346-424e-bc0f-d22322438aac tempest-TestStampPattern-1412773965 None] Created volume successfully. Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:37:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:37:50 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:37:50 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:37:51 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 09 09:37:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.671s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:37:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:37:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:37:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:37:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:37:59 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:37:59 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:38:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:38:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:38:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:38:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5bd27e-92d8-427c-8606-81fe80ffba00]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:38:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:38 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d Jul 09 09:38:38 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:38 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d" returned: 0 in 0.732s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:38:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd', 'name': 'volume-32dafe28-4041-4304-81fb-147fee363e5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e740490-c3bd-4867-9e06-7d1ee34ae810', 'enforce_multipath': True} {{(pid=87265) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 09:38:38 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-d4bebaa1-49e6-48c4-a030-8d1185804971 req-c21696b3-3b29-4d6e-8793-8e67f073d7d9 tempest-TestStampPattern-1412773965 None] attachment_update completed successfully. Jul 09 09:38:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [req-afd92b41-f985-40dc-be67-c94ed7ee1eb9 req-48d6b804-5277-4378-9e86-718bc8fc1b8e tempest-TestStampPattern-1412773965 None] Terminate volume connection completed successfully. Jul 09 09:38:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [req-afd92b41-f985-40dc-be67-c94ed7ee1eb9 req-48d6b804-5277-4378-9e86-718bc8fc1b8e tempest-TestStampPattern-1412773965 None] Deleting attachment 3e740490-c3bd-4867-9e06-7d1ee34ae810. {{(pid=87265) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 09:38:48 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:38:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:50 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:38:50 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:51 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.666s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:38:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:38:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:38:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-32dafe28-4041-4304-81fb-147fee363e5d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "cinder-32dafe28-4041-4304-81fb-147fee363e5d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9404b-f12e-463a-ab38-0889770c9d35]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:38:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:55 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d Jul 09 09:38:55 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:55 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:55 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d Jul 09 09:38:55 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:56 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-32dafe28-4041-4304-81fb-147fee363e5d" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-32dafe28-4041-4304-81fb-147fee363e5d" released by "delete_volume" :: held 1.400s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Created reservations ['c4f6ed80-577b-4ff6-bc4d-e78237c44bef', 'a234707d-791c-4376-a748-8c0acb8f69c1', '11fd0296-3427-4fd2-aa5b-53c7d502449f', 'db744cc7-09e9-46bd-8fcf-5b82f415a1ba'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:38:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:56 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:38:56 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:57 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.631s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:38:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Deleted volume successfully. Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ca8bf363-efcf-4fc9-ba36-5d50d84f6be9 tempest-TestStampPattern-1412773965 None] Lock "cinder-32dafe28-4041-4304-81fb-147fee363e5d-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-7c13a30e-524c-42f4-b6ce-ca2ce014d486-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-7c13a30e-524c-42f4-b6ce-ca2ce014d486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Deleting offline snapshot 7c13a30e-524c-42f4-b6ce-ca2ce014d486 of volume 4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] snapshot_file for this snap is: volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fea0f9-6efb-4626-9e59-82fa64b46019]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:38:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:57 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:38:57 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:58 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.743s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cfb4ba-6495-489c-be8c-72987879cf41]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:58 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:38:58 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:58 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.759s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:58 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:38:58 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:38:59 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 09 09:38:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.708s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:38:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:38:59 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486 Jul 09 09:38:59 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:00 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de.7c13a30e-524c-42f4-b6ce-ca2ce014d486" returned: 0 in 0.611s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-7c13a30e-524c-42f4-b6ce-ca2ce014d486" released by "_delete_snapshot" :: held 2.909s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" released by "delete_snapshot" :: held 2.930s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:00 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Created reservations ['e2662d90-1af5-4152-9fa7-35ec98bd1072', '1894230e-07bc-46a0-8053-33d16b5b6628', '78860d4f-24a6-45d1-853c-60e18cdcd31b', '1dc90df8-9a21-47cb-b0ae-67e160e10318'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Delete snapshot completed successfully. Jul 09 09:39:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4eb13fb-20fe-48a3-be0d-6e9f961c3aff tempest-TestStampPattern-1412773965 None] Lock "cinder-7c13a30e-524c-42f4-b6ce-ca2ce014d486-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-4d432317-2d75-48b1-ad77-6dcb9d58b2de-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "cinder-4d432317-2d75-48b1-ad77-6dcb9d58b2de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Acquiring lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b939ae-ed17-4bbc-92c0-b49e514d2840]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:08 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:39:08 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:09 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:09 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de Jul 09 09:39:09 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:10 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4d432317-2d75-48b1-ad77-6dcb9d58b2de" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "cinder-quobyte-4d432317-2d75-48b1-ad77-6dcb9d58b2de" released by "delete_volume" :: held 1.475s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Created reservations ['5ca7f5bc-9125-41e0-8e4d-6f193ac91ec3', '816b7cd9-fe07-4da8-8a79-c3b5c9878857', '341eff41-1146-4cb3-9859-77dc36c9f953', 'd99a9117-6e60-4368-a0df-12fead8a9b0c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:10 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:10 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:10 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.681s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Deleted volume successfully. Jul 09 09:39:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-014c65ee-d421-43de-a181-fea180d1f9d5 tempest-TestStampPattern-1412773965 None] Lock "cinder-4d432317-2d75-48b1-ad77-6dcb9d58b2de-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (46eeb13b-0ad3-4cbe-a5a0-4458ebc1113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4178964-051d-4377-ab41-99cd78c74239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4178964-051d-4377-ab41-99cd78c74239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15375074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21962202-42df-4734-a030-45dd18c71567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7cf96d-428d-4997-94d7-d56693799e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7cf96d-428d-4997-94d7-d56693799e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe866a5-3307-4585-a0c7-931a6578c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe866a5-3307-4585-a0c7-931a6578c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21962202-42df-4734-a030-45dd18c71567', 'volume_name': 'volume-21962202-42df-4734-a030-45dd18c71567', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9864fe39-73f7-491d-a014-86a78a493657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9864fe39-73f7-491d-a014-86a78a493657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d211214-5f4a-422f-aee1-29fc50c55912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Volume 21962202-42df-4734-a030-45dd18c71567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21962202-42df-4734-a030-45dd18c71567', 'volume_size': 1} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15375074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21962202-42df-4734-a030-45dd18c71567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Creating volume 21962202-42df-4734-a030-45dd18c71567 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:39:20 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:39:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:20 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 1073741824 Jul 09 09:39:20 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (5dcaf622-cbb7-4ca1-82b2-8bd911279d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da613999-bbb2-416e-b704-53690d5176a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da613999-bbb2-416e-b704-53690d5176a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271578201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69837630-e940-4ba4-b77b-c23758d4bc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396cd4c3-6c82-441b-a636-6098eeefff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396cd4c3-6c82-441b-a636-6098eeefff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbbbb5-fa52-4c01-8281-cec039c1d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbbbb5-fa52-4c01-8281-cec039c1d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69837630-e940-4ba4-b77b-c23758d4bc4f', 'volume_name': 'volume-69837630-e940-4ba4-b77b-c23758d4bc4f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b505124-a484-49cb-b8ec-1af7d0d0262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b505124-a484-49cb-b8ec-1af7d0d0262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a31b63a-ca1a-4d76-b7fb-89f831d805af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Volume 69837630-e940-4ba4-b77b-c23758d4bc4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69837630-e940-4ba4-b77b-c23758d4bc4f', 'volume_size': 1} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (373cf948-168f-45cc-a109-ea802e1f52c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3d905c-d383-4a72-8463-bf5f2cc90d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3d905c-d383-4a72-8463-bf5f2cc90d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072626890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590dacd0-8186-4a79-9f48-d782b9908809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bffff49-800c-4024-a49f-68419ea1f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bffff49-800c-4024-a49f-68419ea1f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce843587-dad3-4d30-866a-2d943493b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce843587-dad3-4d30-866a-2d943493b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590dacd0-8186-4a79-9f48-d782b9908809', 'volume_name': 'volume-590dacd0-8186-4a79-9f48-d782b9908809', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bad147a-134d-4178-a5c2-039a18e6e094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bad147a-134d-4178-a5c2-039a18e6e094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aa5c41-fafd-4c2e-98a1-980a72ec8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Volume 590dacd0-8186-4a79-9f48-d782b9908809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590dacd0-8186-4a79-9f48-d782b9908809', 'volume_size': 1} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:21 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 1073741824" returned: 0 in 0.916s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:39:21 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 Jul 09 09:39:21 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (857bdbe0-d781-470a-9169-e9f44b211692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d76acc6-a923-481a-b0b8-a018e7e13f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d76acc6-a923-481a-b0b8-a018e7e13f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29023969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b425c13-0098-4250-b14c-6564d511272e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:22Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c916129-296a-44c5-b37b-7489d88b38fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c916129-296a-44c5-b37b-7489d88b38fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d131b5eb-0662-476b-a2c2-87da4cbd9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d131b5eb-0662-476b-a2c2-87da4cbd9949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b425c13-0098-4250-b14c-6564d511272e', 'volume_name': 'volume-8b425c13-0098-4250-b14c-6564d511272e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5bf3e7-b474-4cd2-b852-aeba11c31f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5bf3e7-b474-4cd2-b852-aeba11c31f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c10d364-a5df-4fe8-810e-458f63302b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:21 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Volume 8b425c13-0098-4250-b14c-6564d511272e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b425c13-0098-4250-b14c-6564d511272e', 'volume_size': 1} Jul 09 09:39:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (aac57504-53a2-4620-962a-9f349f085c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c380173-0da8-40e1-af00-1b8665288fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c380173-0da8-40e1-af00-1b8665288fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1954732845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:22Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e95e1c9-49c2-4fe8-84ef-d9b6a03c2819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e95e1c9-49c2-4fe8-84ef-d9b6a03c2819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec495534-664a-4a0d-99c8-d080e517f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec495534-664a-4a0d-99c8-d080e517f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0', 'volume_name': 'volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942ee994-9d8b-4a90-84a8-77a612156b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942ee994-9d8b-4a90-84a8-77a612156b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f68fe3e-559d-4e1c-b520-40f85ef242ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Volume a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0', 'volume_size': 1} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:22 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271578201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69837630-e940-4ba4-b77b-c23758d4bc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Creating volume 69837630-e940-4ba4-b77b-c23758d4bc4f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:39:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d211214-5f4a-422f-aee1-29fc50c55912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21962202-42df-4734-a030-45dd18c71567', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f 1073741824 Jul 09 09:39:22 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6bb327-51e6-4e04-af73-7ae83e8091f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Volume volume-21962202-42df-4734-a030-45dd18c71567 (21962202-42df-4734-a030-45dd18c71567): created successfully Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6bb327-51e6-4e04-af73-7ae83e8091f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (46eeb13b-0ad3-4cbe-a5a0-4458ebc1113e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d6029506-572b-46b2-bbc0-24c6b5ff267f tempest-CreateVolumesFromImageTest-1956981227 None] Created volume successfully. Jul 09 09:39:23 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f 1073741824" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:23 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f Jul 09 09:39:23 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:24 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f" returned: 0 in 0.608s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072626890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590dacd0-8186-4a79-9f48-d782b9908809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:21Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Creating volume 590dacd0-8186-4a79-9f48-d782b9908809 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:39:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a31b63a-ca1a-4d76-b7fb-89f831d805af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69837630-e940-4ba4-b77b-c23758d4bc4f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:24 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 1073741824 Jul 09 09:39:24 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aefaa79-1eb6-4761-946e-86f8b94d39f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Volume volume-69837630-e940-4ba4-b77b-c23758d4bc4f (69837630-e940-4ba4-b77b-c23758d4bc4f): created successfully Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aefaa79-1eb6-4761-946e-86f8b94d39f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (5dcaf622-cbb7-4ca1-82b2-8bd911279d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-23ca39d5-b501-40ab-8f83-f0f2d5d53ad2 tempest-CreateVolumesFromImageTest-1956981227 None] Created volume successfully. Jul 09 09:39:24 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 1073741824" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:24 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 Jul 09 09:39:24 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:25 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809" returned: 0 in 0.614s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.585s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29023969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b425c13-0098-4250-b14c-6564d511272e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:22Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Creating volume 8b425c13-0098-4250-b14c-6564d511272e {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:39:25 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:25 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e 1073741824 Jul 09 09:39:25 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aa5c41-fafd-4c2e-98a1-980a72ec8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590dacd0-8186-4a79-9f48-d782b9908809', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a216892-22f0-4e2b-9eb9-27b9d7b50a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:25 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Volume volume-590dacd0-8186-4a79-9f48-d782b9908809 (590dacd0-8186-4a79-9f48-d782b9908809): created successfully Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a216892-22f0-4e2b-9eb9-27b9d7b50a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:25 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (373cf948-168f-45cc-a109-ea802e1f52c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1877f48e-d747-400c-a5f8-9d443d3e8f83 tempest-CreateVolumesFromImageTest-1956981227 None] Created volume successfully. Jul 09 09:39:26 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e 1073741824" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:26 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e Jul 09 09:39:26 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:26 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e" returned: 0 in 0.620s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.654s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1954732845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8a3f7732e54b1586584d9396ea4679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:39:22Z,use_quota=True,user_id='25ba190bb3c14afb81a8873edc72ce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Creating volume a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:39:26 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c10d364-a5df-4fe8-810e-458f63302b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b425c13-0098-4250-b14c-6564d511272e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:26 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 1073741824 Jul 09 09:39:26 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc89bfe-2573-42c1-858f-46f4a1dd158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Volume volume-8b425c13-0098-4250-b14c-6564d511272e (8b425c13-0098-4250-b14c-6564d511272e): created successfully Jul 09 09:39:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc89bfe-2573-42c1-858f-46f4a1dd158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (857bdbe0-d781-470a-9169-e9f44b211692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-65e85954-f656-4510-8ed8-488d0265ad8f tempest-CreateVolumesFromImageTest-1956981227 None] Created volume successfully. Jul 09 09:39:27 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 1073741824" returned: 0 in 0.813s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:27 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 Jul 09 09:39:27 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:28 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" returned: 0 in 0.616s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f68fe3e-559d-4e1c-b520-40f85ef242ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab02f51-5b3b-4e8b-a10b-fbdd35ab9577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:39:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Volume volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 (a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0): created successfully Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab02f51-5b3b-4e8b-a10b-fbdd35ab9577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Flow 'volume_create_manager' (aac57504-53a2-4620-962a-9f349f085c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:39:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-44d43493-2838-4ec1-851b-458a08911890 tempest-CreateVolumesFromImageTest-1956981227 None] Created volume successfully. Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-quobyte-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebbf1f8-bfb8-4d87-9158-fc5e4f23bc0f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:28 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 Jul 09 09:39:28 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:29 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:29 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0 Jul 09 09:39:29 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:30 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" returned: 0 in 0.646s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0" released by "delete_volume" :: held 1.440s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Created reservations ['fdf37900-0c94-4980-96df-6f626d2f454b', '761ef37c-04d3-40f5-a6b2-2b2591133ca8', '64cd4ae3-1d13-40a0-bf5a-faded405cf94', 'f27cd8fc-283e-4d9b-be47-61da167b3379'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:30 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:30 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-8b425c13-0098-4250-b14c-6564d511272e-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-8b425c13-0098-4250-b14c-6564d511272e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:30 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Deleted volume successfully. Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-quobyte-8b425c13-0098-4250-b14c-6564d511272e" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e912b713-24a0-475d-b5e9-33f00912e945 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-a8b2ca8a-fec9-4fc5-9020-2ad328fb7ba0-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-8b425c13-0098-4250-b14c-6564d511272e" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:31 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac45e33-b523-407d-a088-82ff57addf17]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:31 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e Jul 09 09:39:31 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:31 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:31 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e Jul 09 09:39:31 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:32 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8b425c13-0098-4250-b14c-6564d511272e" returned: 0 in 0.625s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-8b425c13-0098-4250-b14c-6564d511272e" released by "delete_volume" :: held 1.412s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Created reservations ['b2eb22db-46d0-43a7-954c-a09d2a76dd6d', '59dea984-c8e4-456a-9df2-46db29d92551', 'ccacd6dd-8dba-4047-a922-776518b1740e', '278fe31f-4d81-47dd-90cc-578dedf61ec0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:32 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:32 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:33 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-590dacd0-8186-4a79-9f48-d782b9908809-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.617s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Deleted volume successfully. Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-590dacd0-8186-4a79-9f48-d782b9908809-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ead5c812-8125-4504-a113-19ea911178ae tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-8b425c13-0098-4250-b14c-6564d511272e-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-quobyte-590dacd0-8186-4a79-9f48-d782b9908809" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-590dacd0-8186-4a79-9f48-d782b9908809" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c8b92-9ee3-4423-9109-cc75281437a1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:33 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 Jul 09 09:39:33 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:33 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809" returned: 0 in 0.716s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:33 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809 Jul 09 09:39:33 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:34 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-590dacd0-8186-4a79-9f48-d782b9908809" returned: 0 in 0.620s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-590dacd0-8186-4a79-9f48-d782b9908809" released by "delete_volume" :: held 1.377s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Created reservations ['cdedcf59-b9ba-4574-a07e-1dede2b85177', 'eb47d2ab-113b-4e04-8660-e388c2a323e9', '7fe0aabc-ab50-4463-8edd-92df58ca5a2d', '2ff1a004-687e-4e5b-9720-b4a5236cfcd8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:34 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:34 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-69837630-e940-4ba4-b77b-c23758d4bc4f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:35 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.647s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Deleted volume successfully. Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-69837630-e940-4ba4-b77b-c23758d4bc4f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-30361656-5c47-4b77-a3d8-a2cf8746fa1d tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-590dacd0-8186-4a79-9f48-d782b9908809-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-quobyte-69837630-e940-4ba4-b77b-c23758d4bc4f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-69837630-e940-4ba4-b77b-c23758d4bc4f" acquired by "delete_volume" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797de4e-6f56-47ff-a7e2-8dfb374d24e3]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:35 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f Jul 09 09:39:35 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:36 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f" returned: 0 in 0.726s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:36 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f Jul 09 09:39:36 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:36 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-69837630-e940-4ba4-b77b-c23758d4bc4f" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-69837630-e940-4ba4-b77b-c23758d4bc4f" released by "delete_volume" :: held 1.395s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Created reservations ['f5355f71-365c-476e-bcf9-cf40969c9299', '57b564fa-120c-4fe4-ab06-a53f58dbfc09', 'ebe95c0d-986d-4546-ae9f-b67726bf4c3c', '3aaec3e0-8f4a-4741-99a7-1d346a715e4f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:36 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:36 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-21962202-42df-4734-a030-45dd18c71567-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:37 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-21962202-42df-4734-a030-45dd18c71567-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.656s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Deleted volume successfully. Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1d8c9245-c789-4b3f-92ea-f07446d9ce88 tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-69837630-e940-4ba4-b77b-c23758d4bc4f-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "cinder-quobyte-21962202-42df-4734-a030-45dd18c71567" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-21962202-42df-4734-a030-45dd18c71567" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65411de-c908-4c6b-bee1-e0aaa6002cbe]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:39:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:37 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 Jul 09 09:39:37 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:38 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567" returned: 0 in 0.754s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:38 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567 Jul 09 09:39:38 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:39 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21962202-42df-4734-a030-45dd18c71567" returned: 0 in 0.620s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-quobyte-21962202-42df-4734-a030-45dd18c71567" released by "delete_volume" :: held 1.410s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Created reservations ['5096c71b-7197-452a-96c2-9b4bbd8369a2', '8a7a11ba-004e-4d23-a672-1b4f7bba43a1', 'daf453c9-c057-4705-ba3b-6832070f14a7', '43007507-c783-48be-895f-d71422113076'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:39 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:39 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:39 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.656s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Deleted volume successfully. Jul 09 09:39:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-45bbb088-a9c0-4e54-b4cb-9f7f490b73ad tempest-CreateVolumesFromImageTest-1956981227 None] Lock "cinder-21962202-42df-4734-a030-45dd18c71567-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:39:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=36,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:39:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=79,cinder:SELECT=46,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:39:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:39:50 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:39:50 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:39:51 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 09 09:39:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.644s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:39:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:39:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:39:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:39:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Flow 'volume_create_manager' (148eceff-37fc-4f62-880f-44f12a4ebf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c4323c-dc4e-4dd5-aea7-56e9e16f6b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c4323c-dc4e-4dd5-aea7-56e9e16f6b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934797210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcec427-cd34-4d3a-945d-96e0f4f9bf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25076d6f0a854b2b81a5d7665a24a8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:05Z,use_quota=True,user_id='72b0c43762674f329caecf7a7091ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5ba1c-8954-48c1-ae2a-0a65cbcc65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5ba1c-8954-48c1-ae2a-0a65cbcc65c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00bb41f-1953-47e6-9d81-03499d6c4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00bb41f-1953-47e6-9d81-03499d6c4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcec427-cd34-4d3a-945d-96e0f4f9bf2c', 'volume_name': 'volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec37db1-8ebf-43cb-b22c-0fb18d8b9b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec37db1-8ebf-43cb-b22c-0fb18d8b9b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03891ded-6165-48bb-812c-03675d34bb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:04 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Volume 8bcec427-cd34-4d3a-945d-96e0f4f9bf2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c', 'volume_size': 1} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934797210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcec427-cd34-4d3a-945d-96e0f4f9bf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25076d6f0a854b2b81a5d7665a24a8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:05Z,use_quota=True,user_id='72b0c43762674f329caecf7a7091ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Creating volume 8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:04 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:04 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c 1073741824 Jul 09 09:40:04 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:05 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c 1073741824" returned: 0 in 0.804s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:05 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:05 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:06 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.615s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03891ded-6165-48bb-812c-03675d34bb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e051766-940e-4a29-abd8-3eecbe69d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:06 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Volume volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c (8bcec427-cd34-4d3a-945d-96e0f4f9bf2c): created successfully Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e051766-940e-4a29-abd8-3eecbe69d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:06 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Flow 'volume_create_manager' (148eceff-37fc-4f62-880f-44f12a4ebf47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-facd0bf5-ed35-485a-92e1-84a024fcb9d3 tempest-SnapshotDependencyTests-178765867 None] Created volume successfully. Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Creating offline snapshot 4aad8229-b13e-4b82-9242-b5109bbf58d8 of volume 8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[8369ad95-ebb5-4a12-b70d-28ea2fcdf2ca]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:07 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:07 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:07 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.755s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:07 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 1G Jul 09 09:40:07 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:08 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 1G" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:08 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:08 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:09 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.672s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:09 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 is being set with open permissions: ugo+rw Jul 09 09:40:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:09 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:09 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:10 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.633s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:10 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info Jul 09 09:40:10 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:10 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:10 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info is being set with open permissions: ugo+rw Jul 09 09:40:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:10 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info Jul 09 09:40:10 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:11 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.info" returned: 0 in 0.622s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1e4d2e3d-b10a-48a3-bdaa-de1e29e1aec1 tempest-SnapshotDependencyTests-178765867 None] Create snapshot completed successfully Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Flow 'volume_create_manager' (736b7553-0f62-4141-8bed-9f9e9bd761b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbb3dc2-6bc6-4ea1-ad85-aacdd87c7b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fbb3dc2-6bc6-4ea1-ad85-aacdd87c7b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8e6b6a-c2cb-483e-82ae-85bf05cf1670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25076d6f0a854b2b81a5d7665a24a8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4aad8229-b13e-4b82-9242-b5109bbf58d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:13Z,use_quota=True,user_id='72b0c43762674f329caecf7a7091ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53b4b3-aebc-49b0-990c-a2db45d10a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53b4b3-aebc-49b0-990c-a2db45d10a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9d1f7d-d429-4a85-9dc0-beb4cf30da29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9d1f7d-d429-4a85-9dc0-beb4cf30da29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e8e6b6a-c2cb-483e-82ae-85bf05cf1670', 'volume_name': 'volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670', 'volume_size': 1, 'snapshot_id': '4aad8229-b13e-4b82-9242-b5109bbf58d8'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cc73fb-6da8-4f21-afbb-90047ffdcc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cc73fb-6da8-4f21-afbb-90047ffdcc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5ea977-d799-4b9a-a1a6-77940032b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Volume 2e8e6b6a-c2cb-483e-82ae-85bf05cf1670: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670', 'volume_size': 1, 'snapshot_id': '4aad8229-b13e-4b82-9242-b5109bbf58d8'} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Creating volume 2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 from snapshot 4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] snapshot: 4aad8229-b13e-4b82-9242-b5109bbf58d8, volume: 2e8e6b6a-c2cb-483e-82ae-85bf05cf1670, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f3fbd-6d10-43c7-9e89-eac174954251]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:13 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:13 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:13 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.725s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b5cee7-53e2-44d2-876c-8bdc35c484b2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:13 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:13 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:14 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.752s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:14 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:40:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:14 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 Jul 09 09:40:14 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:18 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" returned: 0 in 4.363s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d36ded-7a67-444c-a5ff-d881e4394884]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:19 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:19 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:19 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.911s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:19 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:40:19 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Converted 1024.00 MB image at 234.65 MB/s Jul 09 09:40:19 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 is being set with open permissions: ugo+rw Jul 09 09:40:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:19 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 Jul 09 09:40:19 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:20 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" returned: 0 in 0.662s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" released by "_copy_volume_from_snapshot" :: held 7.499s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" released by "_create_volume_from_snapshot" :: held 7.525s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.539s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5ea977-d799-4b9a-a1a6-77940032b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670', 'volume_size': 1, 'snapshot_id': '4aad8229-b13e-4b82-9242-b5109bbf58d8'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e0c966-3f8a-43dd-b58f-936766a6cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Volume volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 (2e8e6b6a-c2cb-483e-82ae-85bf05cf1670): created successfully Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e0c966-3f8a-43dd-b58f-936766a6cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Flow 'volume_create_manager' (736b7553-0f62-4141-8bed-9f9e9bd761b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:20 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b18c30b4-ce67-4d75-a922-6a41a796e43f tempest-SnapshotDependencyTests-178765867 None] Created volume successfully. Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-4aad8229-b13e-4b82-9242-b5109bbf58d8-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-4aad8229-b13e-4b82-9242-b5109bbf58d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Deleting offline snapshot 4aad8229-b13e-4b82-9242-b5109bbf58d8 of volume 8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] snapshot_file for this snap is: volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[38058bdf-be50-4cdc-bb73-06a4cc4bf018]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:21 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:21 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:22 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.783s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:40:22 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030545a-3ca3-4457-b14c-f75de9f432bb]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:22 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:22 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:23 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.757s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:23 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:23 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:23 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.718s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:24 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8 Jul 09 09:40:24 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:24 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c.4aad8229-b13e-4b82-9242-b5109bbf58d8" returned: 0 in 0.642s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-4aad8229-b13e-4b82-9242-b5109bbf58d8" released by "_delete_snapshot" :: held 2.987s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" released by "delete_snapshot" :: held 3.007s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Created reservations ['fb6a0863-84a9-4f5b-8d7a-f82444112d98', '54b4c756-fac6-4d54-8685-1cd6d683af4f', 'c18ee749-17b1-4445-bc0c-82c5367ff0db', '04beb9d3-e9fc-4b1d-9f60-71a4b78dbf7b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:40:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Delete snapshot completed successfully. Jul 09 09:40:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4af5c918-ecbd-428c-a3d8-cd178ea25a0c tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-4aad8229-b13e-4b82-9242-b5109bbf58d8-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c420539-cc80-49b9-886b-aa0a8c62c1bb]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:26 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:26 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:26 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:26 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c Jul 09 09:40:26 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:27 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" returned: 0 in 0.641s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c" released by "delete_volume" :: held 1.458s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Created reservations ['e8c22bc8-c902-49d5-8878-d37b18e75e01', 'ffa7434c-cc15-4aac-8c52-02e05f2dbb18', 'c82ac7c3-0a9c-4ee5-8147-3621a9151a74', '0dfde2e4-e4cd-4c7f-8821-f1f605d846fa'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:27 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:40:27 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:28 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.623s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:40:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Deleted volume successfully. Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-66007e10-80e4-4549-863e-bc94c9cedec9 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-8bcec427-cd34-4d3a-945d-96e0f4f9bf2c-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d0b1c-57b3-4bb4-aac2-171035d26321]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:28 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 Jul 09 09:40:28 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:28 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" returned: 0 in 0.726s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:28 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670 Jul 09 09:40:28 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:29 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-quobyte-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670" released by "delete_volume" :: held 1.413s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Created reservations ['985de6f2-b22f-40c8-afc0-ecb9fac095fb', '884607c1-7893-4df0-b019-4620cbc08a5e', 'ab9582b8-3506-40f2-8430-8206ede2e274', 'bc8c3b78-f745-4285-96ab-88130b8ab203'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:29 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:40:29 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:30 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:40:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Deleted volume successfully. Jul 09 09:40:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-307f5524-59c8-4179-9149-163d65f50947 tempest-SnapshotDependencyTests-178765867 None] Lock "cinder-2e8e6b6a-c2cb-483e-82ae-85bf05cf1670-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:40:39 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:40:40 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:40:49 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Flow 'volume_create_manager' (d775d9ea-eaed-40b2-a499-e37f9a71663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1e76d3-344e-4b25-afcd-f49904c4238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1e76d3-344e-4b25-afcd-f49904c4238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-478562796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cbb646-63f0-433b-a5df-d2bff075f792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9621664d154af6b4032a3619e7aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='b8b7cbd6ac43478f9aa3745f9632827c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb56e7-185e-47f0-a4ef-2ce2727ffbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb56e7-185e-47f0-a4ef-2ce2727ffbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758da53f-f119-4210-9348-aa7cadd92a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758da53f-f119-4210-9348-aa7cadd92a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7cbb646-63f0-433b-a5df-d2bff075f792', 'volume_name': 'volume-d7cbb646-63f0-433b-a5df-d2bff075f792', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a229e511-324c-4c0b-acc5-17b7d2a6efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a229e511-324c-4c0b-acc5-17b7d2a6efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7387605a-156a-415b-a9de-dd75aec0f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Volume d7cbb646-63f0-433b-a5df-d2bff075f792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7cbb646-63f0-433b-a5df-d2bff075f792', 'volume_size': 1} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-478562796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cbb646-63f0-433b-a5df-d2bff075f792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9621664d154af6b4032a3619e7aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='b8b7cbd6ac43478f9aa3745f9632827c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Creating volume d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:50 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:50 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 1073741824 Jul 09 09:40:50 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (8cbd58b3-8c68-468d-81cd-433dfcddb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59f38b3-fe92-4ea5-8a45-310c496901c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59f38b3-fe92-4ea5-8a45-310c496901c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154453423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3071743d-c5b3-44f8-a2a3-78f51ab08441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8d5ffd-235b-42dd-8995-ff734f198b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c8d5ffd-235b-42dd-8995-ff734f198b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a1413-b152-4acc-b176-7fc6c826f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a1413-b152-4acc-b176-7fc6c826f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3071743d-c5b3-44f8-a2a3-78f51ab08441', 'volume_name': 'volume-3071743d-c5b3-44f8-a2a3-78f51ab08441', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217b814b-1159-496b-8333-88797ce07983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217b814b-1159-496b-8333-88797ce07983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5022c95-0659-455b-9160-81cae8cfaeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume 3071743d-c5b3-44f8-a2a3-78f51ab08441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3071743d-c5b3-44f8-a2a3-78f51ab08441', 'volume_size': 1} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (b914009f-e76a-4b3a-96b6-a066b99b36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c59eb12-e1eb-49bc-93d9-a456578f850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c59eb12-e1eb-49bc-93d9-a456578f850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-229559106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298a0d9b-36c2-442d-9c83-ca07f2dc04f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdb450c-01ac-4440-bb71-583bb122ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdb450c-01ac-4440-bb71-583bb122ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7c2dc7-6d56-4e09-86f6-5047b59ab53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7c2dc7-6d56-4e09-86f6-5047b59ab53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298a0d9b-36c2-442d-9c83-ca07f2dc04f7', 'volume_name': 'volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9189d4bb-8437-45ec-b0bd-227dccb295cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9189d4bb-8437-45ec-b0bd-227dccb295cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec548add-abfb-437a-baf0-9f8e1e9b6105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Volume 298a0d9b-36c2-442d-9c83-ca07f2dc04f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7', 'volume_size': 1} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:50 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:40:50 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (30deb991-5992-452e-9846-07087632d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba03506-99be-4002-a8e9-53431b1910b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba03506-99be-4002-a8e9-53431b1910b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14561127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0670444-b77f-4f6b-a499-9138f66a4bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:51Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baceb0f4-18b6-4592-b083-b2829e758d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baceb0f4-18b6-4592-b083-b2829e758d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7218e486-f29c-4926-92df-067f4c3a79f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7218e486-f29c-4926-92df-067f4c3a79f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0670444-b77f-4f6b-a499-9138f66a4bc9', 'volume_name': 'volume-d0670444-b77f-4f6b-a499-9138f66a4bc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da121a98-204e-4d6c-8a17-900a1afb097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da121a98-204e-4d6c-8a17-900a1afb097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6194bba-5bea-47a6-a38d-3f574c20d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Volume d0670444-b77f-4f6b-a499-9138f66a4bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0670444-b77f-4f6b-a499-9138f66a4bc9', 'volume_size': 1} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:51 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 1073741824" returned: 0 in 1.283s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (cc171bf7-e662-4d9c-b59c-f73a08d9ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5429807-2ab8-44a0-97e8-055d8ebf3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5429807-2ab8-44a0-97e8-055d8ebf3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947611473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd052459-70e8-4c63-ae8a-c453a0d276c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:51Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daabcbc5-8c51-4196-8fa4-2390d8a2fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daabcbc5-8c51-4196-8fa4-2390d8a2fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf8b935-8063-4288-9183-3bfb651bbafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf8b935-8063-4288-9183-3bfb651bbafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd052459-70e8-4c63-ae8a-c453a0d276c8', 'volume_name': 'volume-bd052459-70e8-4c63-ae8a-c453a0d276c8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc740d-f046-4182-9a13-05eb416c7f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9dc740d-f046-4182-9a13-05eb416c7f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e556565c-2e02-4195-8a97-2e9d2d65b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:51 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Volume bd052459-70e8-4c63-ae8a-c453a0d276c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd052459-70e8-4c63-ae8a-c453a0d276c8', 'volume_size': 1} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:51 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.042s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (9a5f6e64-6e78-4d3b-ae49-b1ea0bafea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54288718-c08e-4319-a50c-739859006a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54288718-c08e-4319-a50c-739859006a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333110630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:52Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57678ced-8a32-401e-8729-d3e4cbb858e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57678ced-8a32-401e-8729-d3e4cbb858e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefe8625-634e-4ef4-a119-0e7321bdb1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefe8625-634e-4ef4-a119-0e7321bdb1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf', 'volume_name': 'volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb002c-aad9-4994-b2c5-70cb7ebf1c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb002c-aad9-4994-b2c5-70cb7ebf1c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7222c8-cb90-4d58-b081-d7ff757170d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Volume 2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf', 'volume_size': 1} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:52 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 0.875s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.144s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154453423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3071743d-c5b3-44f8-a2a3-78f51ab08441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume 3071743d-c5b3-44f8-a2a3-78f51ab08441 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:52 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:52 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 1073741824 Jul 09 09:40:52 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7387605a-156a-415b-a9de-dd75aec0f493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cbb646-63f0-433b-a5df-d2bff075f792', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdf5a33-0232-42b5-bb9e-4fa85d026fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (33f0ca3c-a5fa-42be-8f44-7d7e1a19d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c2a7c9-dbc1-4e06-8b9c-422f46305029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Volume volume-d7cbb646-63f0-433b-a5df-d2bff075f792 (d7cbb646-63f0-433b-a5df-d2bff075f792): created successfully Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdf5a33-0232-42b5-bb9e-4fa85d026fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Flow 'volume_create_manager' (d775d9ea-eaed-40b2-a499-e37f9a71663b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c2a7c9-dbc1-4e06-8b9c-422f46305029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526213882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810d433d-8ff0-4fdb-8445-1d9f0135cb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:52Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28279f9a-f1bf-4549-8368-41ce36304618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28279f9a-f1bf-4549-8368-41ce36304618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc99d818-5b90-4173-bd68-3bdc2ab636b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc99d818-5b90-4173-bd68-3bdc2ab636b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810d433d-8ff0-4fdb-8445-1d9f0135cb46', 'volume_name': 'volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1308c9f8-890e-4e8c-b8f2-5cda12a7b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1308c9f8-890e-4e8c-b8f2-5cda12a7b08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36e1dca-26a2-42ae-aed2-b2fcd35171f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Volume 810d433d-8ff0-4fdb-8445-1d9f0135cb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46', 'volume_size': 1} Jul 09 09:40:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-97c4d7ca-8040-4bd3-8923-11e8d86f0a94 tempest-VolumeDependencyTests-2092276504 None] Created volume successfully. Jul 09 09:40:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:53 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 1073741824" returned: 0 in 0.986s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:53 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 Jul 09 09:40:53 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:54 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.502s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-229559106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298a0d9b-36c2-442d-9c83-ca07f2dc04f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:50Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Creating volume 298a0d9b-36c2-442d-9c83-ca07f2dc04f7 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:54 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:54 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 1073741824 Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5022c95-0659-455b-9160-81cae8cfaeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3071743d-c5b3-44f8-a2a3-78f51ab08441', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bcefc8-a568-4857-9e9e-f18cbf9bd977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 (3071743d-c5b3-44f8-a2a3-78f51ab08441): created successfully Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bcefc8-a568-4857-9e9e-f18cbf9bd977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (8cbd58b3-8c68-468d-81cd-433dfcddb73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Flow 'volume_create_manager' (24e0468c-2db8-4615-b874-bc59370627a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017f012-45e9-4885-8312-7757e6387fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-085e8d51-b66b-4017-828e-7a468ffacfaa tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017f012-45e9-4885-8312-7757e6387fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55303547-ab17-4195-b524-61e2e1dd0b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24454e45e79456c80b24e5c9114b04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:54Z,use_quota=True,user_id='8e62f2c71fd74e269ebe3d661247b820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2e52cdd-d691-452a-9bcb-2acbe82f5ac3),volume_type_id=c2e52cdd-d691-452a-9bcb-2acbe82f5ac3)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a16a9e-1c86-466d-a820-8fbc7f015bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a16a9e-1c86-466d-a820-8fbc7f015bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5b8f6-e0f7-4cbb-990d-359a55957e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5b8f6-e0f7-4cbb-990d-359a55957e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55303547-ab17-4195-b524-61e2e1dd0b03', 'volume_name': 'volume-55303547-ab17-4195-b524-61e2e1dd0b03', 'volume_size': 1, 'image_id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '273b484fe05ab53a99c7cb09b03e5753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c24454e45e79456c80b24e5c9114b04c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4318a1d8c738cbcbe91c21c1b4b1b77b6b4a09adcd067f3c8160c8ac7c49ec52380a736aad1933e9e64ea265a0ec789f964e1e1f147f2795810a021d630b60aa', 'id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'created_at': datetime.datetime(2026, 7, 9, 7, 40, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 40, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478df238-11b8-4eeb-bf5e-7ec9a82d5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478df238-11b8-4eeb-bf5e-7ec9a82d5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093af389-b91f-4872-a7c3-288bdb253f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Volume 55303547-ab17-4195-b524-61e2e1dd0b03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55303547-ab17-4195-b524-61e2e1dd0b03', 'volume_size': 1, 'image_id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '273b484fe05ab53a99c7cb09b03e5753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c24454e45e79456c80b24e5c9114b04c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4318a1d8c738cbcbe91c21c1b4b1b77b6b4a09adcd067f3c8160c8ac7c49ec52380a736aad1933e9e64ea265a0ec789f964e1e1f147f2795810a021d630b60aa', 'id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'created_at': datetime.datetime(2026, 7, 9, 7, 40, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 40, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Trying to clone 55303547-ab17-4195-b524-61e2e1dd0b03 from image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd at location (None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:40:54 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Image download 0.00 MB at 0.00 MB/s Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d736d58-fcda-4cec-a6f5-fab3e2b92ebc]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:54 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:40:54 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:54 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 1073741824" returned: 0 in 0.851s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:54 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 Jul 09 09:40:54 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:55 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 0 in 0.792s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:55 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:40:55 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:55 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" returned: 0 in 0.676s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.395s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14561127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0670444-b77f-4f6b-a499-9138f66a4bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:51Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Creating volume d0670444-b77f-4f6b-a499-9138f66a4bc9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:55 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:55 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 1073741824 Jul 09 09:40:55 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec548add-abfb-437a-baf0-9f8e1e9b6105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adccc67-841e-4037-91d3-baaa94c68103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Volume volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 (298a0d9b-36c2-442d-9c83-ca07f2dc04f7): created successfully Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8adccc67-841e-4037-91d3-baaa94c68103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (b914009f-e76a-4b3a-96b6-a066b99b36f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (06ea05e9-c2e8-4ebe-a99a-419dd4d80cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1919aa5b-2713-402e-ab8a-0694466aedc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-68c98c46-d87c-4a7b-8af0-d3ea47e3361c tempest-CreateVolumesFromImageTest-801451761 None] Created volume successfully. Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1919aa5b-2713-402e-ab8a-0694466aedc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668745507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538328d9-bc90-4fa2-9f25-b69d4f570d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:56Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f238864-b5a6-49a0-9e81-986d23c4eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f238864-b5a6-49a0-9e81-986d23c4eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3a7ea-a0e2-462a-97cc-7b3a28d21acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3a7ea-a0e2-462a-97cc-7b3a28d21acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538328d9-bc90-4fa2-9f25-b69d4f570d47', 'volume_name': 'volume-538328d9-bc90-4fa2-9f25-b69d4f570d47', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e77c8a9-75b5-46ab-aaec-239574544bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e77c8a9-75b5-46ab-aaec-239574544bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1cb882-dc24-4464-865c-a0dff0586860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:55 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume 538328d9-bc90-4fa2-9f25-b69d4f570d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538328d9-bc90-4fa2-9f25-b69d4f570d47', 'volume_size': 1} Jul 09 09:40:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (4b82357d-7926-4f31-8867-c0bb43447399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457179db-41ee-45dd-803a-e56c3f026a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457179db-41ee-45dd-803a-e56c3f026a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691141968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab44a45-6222-41a1-9f17-7df46a54ab73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:56Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cffd49e-0005-446a-bce5-ea071cc89bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cffd49e-0005-446a-bce5-ea071cc89bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b561ff-ec9e-4cfb-a927-41d39ece782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b561ff-ec9e-4cfb-a927-41d39ece782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab44a45-6222-41a1-9f17-7df46a54ab73', 'volume_name': 'volume-4ab44a45-6222-41a1-9f17-7df46a54ab73', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b196c108-08b7-4d46-b83a-718012184ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b196c108-08b7-4d46-b83a-718012184ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9264c7c7-b1a1-4bba-8d19-687fd4575fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume 4ab44a45-6222-41a1-9f17-7df46a54ab73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab44a45-6222-41a1-9f17-7df46a54ab73', 'volume_size': 1} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:56 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 1 in 0.928s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Temporary image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd is fetched for user 8e62f2c71fd74e269ebe3d661247b820. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8787da7-75cf-4953-8178-0f373301a09f]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:56 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:40:56 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (4d22f9d1-482a-42bc-9a28-bcb2e78daf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf8336e-a706-4bbd-947b-4b596a00e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf8336e-a706-4bbd-947b-4b596a00e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737326053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b01ddb-5830-449b-a7ce-3a5c3b17b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:57Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4b9ebd-cb15-417d-904c-5eaabf24e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4b9ebd-cb15-417d-904c-5eaabf24e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96b653f-d3d9-416f-913b-4787937fbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96b653f-d3d9-416f-913b-4787937fbf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b01ddb-5830-449b-a7ce-3a5c3b17b888', 'volume_name': 'volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6163dcfd-d0d4-470c-a404-5993b5b24b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6163dcfd-d0d4-470c-a404-5993b5b24b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5268f7fa-0225-4be6-8278-78f6061202cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume d3b01ddb-5830-449b-a7ce-3a5c3b17b888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888', 'volume_size': 1} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:56 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 1073741824" returned: 0 in 1.185s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:56 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 Jul 09 09:40:56 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (bbacb725-6ed3-4b21-b65f-ebf7bdcc3e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1119e985-f768-41f0-97ff-9f3426c8065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1119e985-f768-41f0-97ff-9f3426c8065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960285468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfb3616-e272-44e8-9ac0-19d93c1db11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:57Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a0e8b9-bfa6-4048-8fa5-3b9e18bf56f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a0e8b9-bfa6-4048-8fa5-3b9e18bf56f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283f8eb-9c6c-4a30-baa9-cf96a62c33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283f8eb-9c6c-4a30-baa9-cf96a62c33bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfb3616-e272-44e8-9ac0-19d93c1db11b', 'volume_name': 'volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d92df2-a1c3-4571-bf98-f47229ab3b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d92df2-a1c3-4571-bf98-f47229ab3b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af7cd2d-3989-4a5f-8f20-e8929733aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume 2dfb3616-e272-44e8-9ac0-19d93c1db11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b', 'volume_size': 1} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:57 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 0 in 0.939s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:57 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:40:57 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (1efc5356-c2ad-4051-bf9e-f4cb0d77a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87e69c3-15dc-467a-844f-57bd95ac94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87e69c3-15dc-467a-844f-57bd95ac94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470126579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:58Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d0b378-6d53-4081-8d95-11e59610f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d0b378-6d53-4081-8d95-11e59610f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7f906-556c-4113-a3a4-f161348ecaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f7f906-556c-4113-a3a4-f161348ecaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef', 'volume_name': 'volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6611b1e0-b703-4977-aa0a-328df1df363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6611b1e0-b703-4977-aa0a-328df1df363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec652eb-e178-4626-9bef-7c488a586a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume 6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef', 'volume_size': 1} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:57 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9" returned: 0 in 0.796s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.135s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947611473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd052459-70e8-4c63-ae8a-c453a0d276c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:51Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Creating volume bd052459-70e8-4c63-ae8a-c453a0d276c8 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:57 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6194bba-5bea-47a6-a38d-3f574c20d570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0670444-b77f-4f6b-a499-9138f66a4bc9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 1073741824 Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b1cedf-6833-429c-9a62-7f8de294c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:57 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Volume volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 (d0670444-b77f-4f6b-a499-9138f66a4bc9): created successfully Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b1cedf-6833-429c-9a62-7f8de294c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (30deb991-5992-452e-9846-07087632d4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-139c6e29-680b-4c41-9607-8ee5d02b1f17 tempest-CreateVolumesFromImageTest-801451761 None] Created volume successfully. Jul 09 09:40:58 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 1 in 0.783s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:40:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:58 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 1073741824" returned: 0 in 0.850s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:58 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 Jul 09 09:40:58 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:59 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8" returned: 0 in 0.666s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.163s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333110630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:52Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Creating volume 2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:40:59 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e556565c-2e02-4195-8a97-2e9d2d65b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd052459-70e8-4c63-ae8a-c453a0d276c8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd171f1-cbfa-48b1-b0ad-f51b511cd673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:40:59 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf 1073741824 Jul 09 09:40:59 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:40:59 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Volume volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 (bd052459-70e8-4c63-ae8a-c453a0d276c8): created successfully Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd171f1-cbfa-48b1-b0ad-f51b511cd673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:40:59 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (cc171bf7-e662-4d9c-b59c-f73a08d9ead3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:40:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ee5967ef-70fc-4819-a036-321a40b207e3 tempest-CreateVolumesFromImageTest-801451761 None] Created volume successfully. Jul 09 09:41:00 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf 1073741824" returned: 0 in 0.824s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:00 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf Jul 09 09:41:00 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:00 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.174s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1526213882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810d433d-8ff0-4fdb-8445-1d9f0135cb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf4d6e607034f388ad6fb5db2d55349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:52Z,use_quota=True,user_id='98ae244116a74a788e8c04a9050d892e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Creating volume 810d433d-8ff0-4fdb-8445-1d9f0135cb46 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:00 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:00 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 1073741824 Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7222c8-cb90-4d58-b081-d7ff757170d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:00 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c7db00-b082-4510-a978-f2a07d7c030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Volume volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf (2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf): created successfully Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c7db00-b082-4510-a978-f2a07d7c030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (9a5f6e64-6e78-4d3b-ae49-b1ea0bafea64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-241aaa64-6f83-44aa-9c3d-f1b85ed65582 tempest-CreateVolumesFromImageTest-801451761 None] Created volume successfully. Jul 09 09:41:01 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 1073741824" returned: 0 in 0.847s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:01 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 Jul 09 09:41:01 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:02 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.095s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36e1dca-26a2-42ae-aed2-b2fcd35171f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcadcbc-5999-4c87-83be-3af7b7449422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Creating offline snapshot 6b23225e-a755-4021-8092-2a285678f76b of volume d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:41:02 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Volume volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 (810d433d-8ff0-4fdb-8445-1d9f0135cb46): created successfully Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcadcbc-5999-4c87-83be-3af7b7449422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Flow 'volume_create_manager' (33f0ca3c-a5fa-42be-8f44-7d7e1a19d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf996b-adcc-4303-ad21-57cf51ede011]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8ebb42e0-0798-4c79-bd66-8aefaf2036cd tempest-CreateVolumesFromImageTest-801451761 None] Created volume successfully. Jul 09 09:41:02 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:02 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:03 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 0.873s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:03 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b 1G Jul 09 09:41:03 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-810d433d-8ff0-4fdb-8445-1d9f0135cb46-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-810d433d-8ff0-4fdb-8445-1d9f0135cb46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-quobyte-810d433d-8ff0-4fdb-8445-1d9f0135cb46" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-810d433d-8ff0-4fdb-8445-1d9f0135cb46" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b242cd-7711-4d8e-9c54-3aac60c8d057]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:03 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 Jul 09 09:41:03 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:04 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b 1G" returned: 0 in 0.868s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7cbb646-63f0-433b-a5df-d2bff075f792 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:04 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7cbb646-63f0-433b-a5df-d2bff075f792 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:04 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:04 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46" returned: 0 in 0.834s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:04 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46 Jul 09 09:41:04 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:04 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7cbb646-63f0-433b-a5df-d2bff075f792 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 0.760s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:04 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b is being set with open permissions: ugo+rw Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:04 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:04 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:04 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-810d433d-8ff0-4fdb-8445-1d9f0135cb46" returned: 0 in 0.699s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-810d433d-8ff0-4fdb-8445-1d9f0135cb46" released by "delete_volume" :: held 1.588s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Created reservations ['0c5282c6-28ac-41fb-8b72-64e5cad2aeba', 'e69cc834-2554-4e73-a40b-e42c3045800d', 'd2fbcba9-5ed9-4393-9609-196d1a56949d', '70e4752d-985d-49cf-a5d6-6dd43510395c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:05 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:05 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:05 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-quobyte-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:05 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info Jul 09 09:41:05 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[876726b3-6af0-4cb7-be2a-9859b642e3bd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:05 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.703s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Deleted volume successfully. Jul 09 09:41:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-ef3e5add-9eda-445f-95e0-17eeaa7392b5 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-810d433d-8ff0-4fdb-8445-1d9f0135cb46-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:05 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf Jul 09 09:41:05 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:06 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info" returned: 0 in 0.691s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:06 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info is being set with open permissions: ugo+rw Jul 09 09:41:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:06 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info Jul 09 09:41:06 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:06 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" returned: 0 in 0.818s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:06 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf Jul 09 09:41:06 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:07 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.info" returned: 0 in 0.690s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.170s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668745507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538328d9-bc90-4fa2-9f25-b69d4f570d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:56Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume 538328d9-bc90-4fa2-9f25-b69d4f570d47 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:07 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:07 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 1073741824 Jul 09 09:41:07 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-5a9e23f3-75ef-40b2-b180-52473011da23 tempest-VolumeDependencyTests-2092276504 None] Create snapshot completed successfully Jul 09 09:41:07 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" returned: 0 in 0.702s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf" released by "delete_volume" :: held 1.572s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Created reservations ['7774c67e-c3a2-418b-a65f-e6f57fc7c90f', 'fd1f76a3-a624-4229-a172-a9731f2cca87', '22e23c40-1e68-4c25-b48e-0b5fe8ae59ae', '291cb89e-6691-4ff3-b147-95454c4aad88'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:07 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:07 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-bd052459-70e8-4c63-ae8a-c453a0d276c8-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-bd052459-70e8-4c63-ae8a-c453a0d276c8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-quobyte-bd052459-70e8-4c63-ae8a-c453a0d276c8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-bd052459-70e8-4c63-ae8a-c453a0d276c8" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba560f-1505-464b-8c68-c924b06dbf54]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:08 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 Jul 09 09:41:08 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:08 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 1073741824" returned: 0 in 1.079s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:08 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 Jul 09 09:41:08 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:08 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.917s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:08 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Deleted volume successfully. Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9ce4e356-2348-40f2-a68d-928646e7b823 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-2a0c3b4f-2d4e-41a8-89c7-6b847baafdbf-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Flow 'volume_create_manager' (01ec09b9-582b-4200-946a-548fdeada47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d56966-2216-44e4-a71e-9e2d2c2533e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d56966-2216-44e4-a71e-9e2d2c2533e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-382123338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ac671b-311b-4ce2-a276-7fe49de87a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f9621664d154af6b4032a3619e7aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b23225e-a755-4021-8092-2a285678f76b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:08Z,use_quota=True,user_id='b8b7cbd6ac43478f9aa3745f9632827c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee01d9-f022-4f06-8c8e-b8747878bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee01d9-f022-4f06-8c8e-b8747878bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b551e633-baa3-4460-ab61-404a14d0415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b551e633-baa3-4460-ab61-404a14d0415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48ac671b-311b-4ce2-a276-7fe49de87a87', 'volume_name': 'volume-48ac671b-311b-4ce2-a276-7fe49de87a87', 'volume_size': 1, 'snapshot_id': '6b23225e-a755-4021-8092-2a285678f76b'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cedc74c-31d7-4905-a051-7002f47dc05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cedc74c-31d7-4905-a051-7002f47dc05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5bf41b-fd0f-4ac2-90d9-781251723b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:08 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Volume 48ac671b-311b-4ce2-a276-7fe49de87a87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48ac671b-311b-4ce2-a276-7fe49de87a87', 'volume_size': 1, 'snapshot_id': '6b23225e-a755-4021-8092-2a285678f76b'} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:08 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:08 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8 Jul 09 09:41:08 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:08 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47" returned: 0 in 0.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.635s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691141968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab44a45-6222-41a1-9f17-7df46a54ab73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:56Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume 4ab44a45-6222-41a1-9f17-7df46a54ab73 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:08 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:08 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 1073741824 Jul 09 09:41:08 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1cb882-dc24-4464-865c-a0dff0586860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538328d9-bc90-4fa2-9f25-b69d4f570d47', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d8b912-6a81-4329-8ad3-5b39ebc20d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:09 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 (538328d9-bc90-4fa2-9f25-b69d4f570d47): created successfully Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d8b912-6a81-4329-8ad3-5b39ebc20d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (06ea05e9-c2e8-4ebe-a99a-419dd4d80cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0f869e81-ee19-4156-85f7-e40eac4b7ace tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:41:09 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-bd052459-70e8-4c63-ae8a-c453a0d276c8" returned: 0 in 0.677s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-bd052459-70e8-4c63-ae8a-c453a0d276c8" released by "delete_volume" :: held 1.589s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Created reservations ['8696176a-ed31-4e7f-885d-32e7d1452df5', '06320909-cda3-4c8a-9464-90b6d795a491', 'eea03a47-6e8a-4d33-83f8-77f96305ee93', 'c2105fbb-e2d1-46db-9d0c-4b8403f7593d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:09 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:09 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:09 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 1073741824" returned: 0 in 0.870s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:09 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 Jul 09 09:41:09 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-d0670444-b77f-4f6b-a499-9138f66a4bc9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-d0670444-b77f-4f6b-a499-9138f66a4bc9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-quobyte-d0670444-b77f-4f6b-a499-9138f66a4bc9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-d0670444-b77f-4f6b-a499-9138f66a4bc9" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[73903c25-3be4-4f8c-aa56-1489fcdaac39]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:10 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.686s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Deleted volume successfully. Jul 09 09:41:10 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 Jul 09 09:41:10 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a715a678-ee91-4950-890d-621fe46e74ff tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-bd052459-70e8-4c63-ae8a-c453a0d276c8-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:10 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73" returned: 0 in 0.712s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.827s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737326053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b01ddb-5830-449b-a7ce-3a5c3b17b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:57Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume d3b01ddb-5830-449b-a7ce-3a5c3b17b888 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:10 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:10 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 1073741824 Jul 09 09:41:10 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9264c7c7-b1a1-4bba-8d19-687fd4575fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab44a45-6222-41a1-9f17-7df46a54ab73', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc770c4-1191-43f2-9f48-94014fa57716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:10 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 (4ab44a45-6222-41a1-9f17-7df46a54ab73): created successfully Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc770c4-1191-43f2-9f48-94014fa57716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (4b82357d-7926-4f31-8867-c0bb43447399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-17c94c12-a194-43f1-9302-ea6c011f7482 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:41:10 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9" returned: 0 in 0.781s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:11 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9 Jul 09 09:41:11 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:11 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 1073741824" returned: 0 in 0.869s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:11 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 Jul 09 09:41:11 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:11 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d0670444-b77f-4f6b-a499-9138f66a4bc9" returned: 0 in 0.686s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-d0670444-b77f-4f6b-a499-9138f66a4bc9" released by "delete_volume" :: held 1.507s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Created reservations ['bf4ba9d8-e912-4277-83d8-1df20332a8a3', '8d2d26cf-2fe5-450b-98d5-6708735b9458', '7c1c2bca-10d2-4441-94d8-17d2dbf5cf7f', '8c8a5991-0646-4d42-99db-022f3bacebd6'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:11 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:11 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:12 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" returned: 0 in 0.660s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.014s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960285468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfb3616-e272-44e8-9ac0-19d93c1db11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:57Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume 2dfb3616-e272-44e8-9ac0-19d93c1db11b {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:12 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:12 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b 1073741824 Jul 09 09:41:12 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5268f7fa-0225-4be6-8278-78f6061202cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f8052b-a7be-4ca3-8b36-84020b514871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:12 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 (d3b01ddb-5830-449b-a7ce-3a5c3b17b888): created successfully Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f8052b-a7be-4ca3-8b36-84020b514871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (4d22f9d1-482a-42bc-9a28-bcb2e78daf1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fb5d8000-2a7c-4ca0-bf72-fbb232d9cab1 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-298a0d9b-36c2-442d-9c83-ca07f2dc04f7-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-298a0d9b-36c2-442d-9c83-ca07f2dc04f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "cinder-quobyte-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7802ac36-b645-4fe4-8e13-992cc2ac9f57]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:12 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.724s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Deleted volume successfully. Jul 09 09:41:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f9593a8e-1478-44e9-9eac-80fc8ee8b2fa tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-d0670444-b77f-4f6b-a499-9138f66a4bc9-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:12 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 Jul 09 09:41:12 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:13 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b 1073741824" returned: 0 in 0.879s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:13 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b Jul 09 09:41:13 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:13 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" returned: 0 in 0.790s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:13 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7 Jul 09 09:41:13 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:13 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b" returned: 0 in 0.687s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.120s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470126579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c11337649d441bbc7a4703c7b3681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:58Z,use_quota=True,user_id='8d523e96786e4239a5839e9fda23275f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Creating volume 6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:13 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af7cd2d-3989-4a5f-8f20-e8929733aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:13 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef 1073741824 Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f84794b-ae70-467b-b704-9ba1222e2b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:13 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:13 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b (2dfb3616-e272-44e8-9ac0-19d93c1db11b): created successfully Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f84794b-ae70-467b-b704-9ba1222e2b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (bbacb725-6ed3-4b21-b65f-ebf7bdcc3e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ad509800-e780-4af6-a162-dcb5c2c9e365 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:41:13 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" returned: 0 in 0.647s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-quobyte-298a0d9b-36c2-442d-9c83-ca07f2dc04f7" released by "delete_volume" :: held 1.496s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Created reservations ['2c478df1-f43a-486f-8377-242ec5f8f150', 'cfaf9946-d977-4a45-98ae-dee6813ef68f', '5cb724f7-20a3-48e0-a450-5d865497e7c8', 'aadf3845-709f-48d2-9f4d-e97f2ae4a688'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:14 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:14 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:14 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef 1073741824" returned: 0 in 0.847s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:14 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef Jul 09 09:41:14 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:14 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.752s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:14 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Deleted volume successfully. Jul 09 09:41:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-22684825-786a-4601-ad05-efcb0d39e875 tempest-CreateVolumesFromImageTest-801451761 None] Lock "cinder-298a0d9b-36c2-442d-9c83-ca07f2dc04f7-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:15 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.224s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55303547-ab17-4195-b524-61e2e1dd0b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24454e45e79456c80b24e5c9114b04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:40:54Z,use_quota=True,user_id='8e62f2c71fd74e269ebe3d661247b820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2e52cdd-d691-452a-9bcb-2acbe82f5ac3),volume_type_id=c2e52cdd-d691-452a-9bcb-2acbe82f5ac3)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Creating volume 55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:15 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec652eb-e178-4626-9bef-7c488a586a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df614123-9c0a-49f9-b3ee-25d1463d1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:15 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1073741824 Jul 09 09:41:15 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:15 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Volume volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef (6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef): created successfully Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df614123-9c0a-49f9-b3ee-25d1463d1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Flow 'volume_create_manager' (1efc5356-c2ad-4051-bf9e-f4cb0d77a89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e24fc70b-7b57-4d22-bfe8-e065f3e60ea8 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created volume successfully. Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b6a03d-213a-4d08-b56c-74e43096c3a1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:16 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef Jul 09 09:41:16 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:16 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1073741824" returned: 0 in 1.035s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:16 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:16 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:16 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:16 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef Jul 09 09:41:16 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:17 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 0 in 0.689s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.628s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b-48ac671b-311b-4ce2-a276-7fe49de87a87" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b-48ac671b-311b-4ce2-a276-7fe49de87a87" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Creating volume 48ac671b-311b-4ce2-a276-7fe49de87a87 from snapshot 6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Attempting download of 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd ((None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}])) to volume 55303547-ab17-4195-b524-61e2e1dd0b03. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] snapshot: 6b23225e-a755-4021-8092-2a285678f76b, volume: 48ac671b-311b-4ce2-a276-7fe49de87a87, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dad16c3-da1a-4d53-b865-0264aac416a2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fca2d8-003b-4917-9777-00eddec77220]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:17 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:17 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:17 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo Jul 09 09:41:17 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:17 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" returned: 0 in 0.795s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef" released by "delete_volume" :: held 1.707s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['70d1414d-5013-47f3-a92f-79e361619331', '29534480-ccfa-456b-8528-4d4613e965d9', '77a3f8af-3b64-4e84-a4f0-167e4995fad3', 'cf6fb2e9-722f-4a56-871a-944922ec93f6'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:17 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:17 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (acbb17b6-9c61-4599-a7b8-c9e5202a4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55f72ff-0bda-4590-919a-c276b00709d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55f72ff-0bda-4590-919a-c276b00709d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032120239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:18Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:17 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd72aeb-2023-4ccb-8bda-c094bee20b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd72aeb-2023-4ccb-8bda-c094bee20b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bd7aa9-4c76-406e-a759-da60c2c6d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bd7aa9-4c76-406e-a759-da60c2c6d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f', 'volume_name': 'volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89ee96-7be8-4a89-9494-d38d4c758333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89ee96-7be8-4a89-9494-d38d4c758333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3790550-b4ec-425d-a710-4f935b445699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:18 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume 0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f', 'volume_size': 1} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-2dfb3616-e272-44e8-9ac0-19d93c1db11b-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-2dfb3616-e272-44e8-9ac0-19d93c1db11b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-2dfb3616-e272-44e8-9ac0-19d93c1db11b" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-2dfb3616-e272-44e8-9ac0-19d93c1db11b" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e979c1-d52a-4b62-bcd3-17bda7a2ee17]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:18 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 1.013s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7cbb646-63f0-433b-a5df-d2bff075f792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0758b2a7-bc83-41d3-96e1-599edfe8c612]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:18 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo" returned: 0 in 1.038s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:18 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b Jul 09 09:41:18 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:18 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:18 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:18 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo Jul 09 09:41:18 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:18 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-de16677c-34c1-4cb5-8332-ecb2afec08ef tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-6ffd9d5b-14cc-44a6-a6eb-ee33211f39ef-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:19 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:19 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b Jul 09 09:41:19 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:19 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 0.837s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:19 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 Jul 09 09:41:19 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:19 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo" returned: 1 in 0.878s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_qv797zmo' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d097970-01e5-4d86-a2d6-e94830ca10d1]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:19 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:41:19 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:19 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2dfb3616-e272-44e8-9ac0-19d93c1db11b" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-2dfb3616-e272-44e8-9ac0-19d93c1db11b" released by "delete_volume" :: held 1.502s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['6588579c-4f40-409e-89d1-8714943bfb64', '0d1a6aaa-460d-49e0-b36a-128e568ba363', 'd14b94de-30c6-4216-998f-52a84911b3bd', '1f20d54e-29d2-4da6-8ca2-b9a885060ad7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:20 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:20 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:20 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:20 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD Jul 09 09:41:20 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-d3b01ddb-5830-449b-a7ce-3a5c3b17b888-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-d3b01ddb-5830-449b-a7ce-3a5c3b17b888-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" acquired by "delete_volume" :: waited 0.074s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[98239325-7d0d-482e-b40f-e7f769dd9cc7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:21 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 Jul 09 09:41:21 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:21 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.916s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:21 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:21 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-216b77fd-7228-42ba-b776-c55cb84dfa16 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-2dfb3616-e272-44e8-9ac0-19d93c1db11b-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:22 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD" returned: 1 in 2.108s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd was raw, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:22 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:22 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:22 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" returned: 0 in 1.828s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:22 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888 Jul 09 09:41:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:24 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 0 in 1.871s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1d41409c-7f8e-45ce-b9ce-302cedbd8ffd_4w1f9xs5devstack@QuobyteHD, size 0.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:41:24 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:24 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1G Jul 09 09:41:24 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:24 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" returned: 0 in 1.844s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-d3b01ddb-5830-449b-a7ce-3a5c3b17b888" released by "delete_volume" :: held 3.793s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['cd1433ab-7370-4e24-a13b-843aaf687af0', '60713c2d-93d7-4786-ac34-578cb405c6d6', '39a35647-e35a-49bb-8c7b-eb3662fb6852', 'd49dace5-a8a0-4e87-b11d-c1f3f5a816b6'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:25 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:25 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:25 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87" returned: 0 in 6.184s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-4ab44a45-6222-41a1-9f17-7df46a54ab73-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffdd75e-0f6c-46b0-9bbc-ef7e93e73787]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-4ab44a45-6222-41a1-9f17-7df46a54ab73-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-4ab44a45-6222-41a1-9f17-7df46a54ab73" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-4ab44a45-6222-41a1-9f17-7df46a54ab73" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5765a97-739c-4f30-8c40-001f034020a4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:25 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:25 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:25 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 Jul 09 09:41:25 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:25 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 1G" returned: 0 in 1.705s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b05ab6-3ce2-422f-91eb-4ffe242165c9]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:25 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:25 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:26 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.031s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:26 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-9fc4c6e0-2f8a-4188-9e00-2c76fb6c8226 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-d3b01ddb-5830-449b-a7ce-3a5c3b17b888-delete_volume" released by "delete_volume" :: held 5.369s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:26 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:26 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 1.085s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:41:26 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Converted 1024.00 MB image at 165.54 MB/s Jul 09 09:41:26 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 is being set with open permissions: ugo+rw Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:26 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73 Jul 09 09:41:26 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:26 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 Jul 09 09:41:26 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:26 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 0 in 0.832s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:26 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:26 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:27 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-4ab44a45-6222-41a1-9f17-7df46a54ab73" returned: 0 in 0.706s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:27 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-4ab44a45-6222-41a1-9f17-7df46a54ab73" released by "delete_volume" :: held 1.676s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b-48ac671b-311b-4ce2-a276-7fe49de87a87" released by "_create_volume_from_snapshot" :: held 10.029s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.060s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.264s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032120239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:18Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume 0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:27 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:27 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f 1073741824 Jul 09 09:41:27 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5bf41b-fd0f-4ac2-90d9-781251723b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ac671b-311b-4ce2-a276-7fe49de87a87', 'volume_size': 1, 'snapshot_id': '6b23225e-a755-4021-8092-2a285678f76b'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9b4c48-14a8-4a4c-b511-ed3366d31eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['036e2133-b65a-459d-a03a-dd34680cb2ee', '593bfd8e-64d7-4b43-ae7c-f4c33a6f3917', 'ea62a328-22d6-4c92-b726-2331f68a324f', 'c72cbb4c-9d79-43d1-97df-3c62d46182f7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:27 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Volume volume-48ac671b-311b-4ce2-a276-7fe49de87a87 (48ac671b-311b-4ce2-a276-7fe49de87a87): created successfully Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9b4c48-14a8-4a4c-b511-ed3366d31eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Flow 'volume_create_manager' (01ec09b9-582b-4200-946a-548fdeada47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3e493fdd-5026-430c-9c3a-187032d919fa tempest-VolumeDependencyTests-2092276504 None] Created volume successfully. Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:27 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:27 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 1 in 0.801s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Downloaded image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd ((None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}])) to volume 55303547-ab17-4195-b524-61e2e1dd0b03 successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Temporary image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd for user 8e62f2c71fd74e269ebe3d661247b820 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:41:27 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Marking volume 55303547-ab17-4195-b524-61e2e1dd0b03 as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Copying metadata from image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd to 55303547-ab17-4195-b524-61e2e1dd0b03. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Creating volume glance metadata for volume 55303547-ab17-4195-b524-61e2e1dd0b03 backed by image 1d41409c-7f8e-45ce-b9ce-302cedbd8ffd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '273b484fe05ab53a99c7cb09b03e5753', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093af389-b91f-4872-a7c3-288bdb253f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55303547-ab17-4195-b524-61e2e1dd0b03', 'volume_size': 1, 'image_id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '273b484fe05ab53a99c7cb09b03e5753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c24454e45e79456c80b24e5c9114b04c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4318a1d8c738cbcbe91c21c1b4b1b77b6b4a09adcd067f3c8160c8ac7c49ec52380a736aad1933e9e64ea265a0ec789f964e1e1f147f2795810a021d630b60aa', 'id': '1d41409c-7f8e-45ce-b9ce-302cedbd8ffd', 'created_at': datetime.datetime(2026, 7, 9, 7, 40, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 40, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d41409c-7f8e-45ce-b9ce-302cedbd8ffd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dbc61e-f916-4108-a220-7b483667c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:27 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Volume volume-55303547-ab17-4195-b524-61e2e1dd0b03 (55303547-ab17-4195-b524-61e2e1dd0b03): created successfully Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dbc61e-f916-4108-a220-7b483667c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Flow 'volume_create_manager' (24e0468c-2db8-4615-b874-bc59370627a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:27 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-780753d2-b866-49bf-b2ca-a837f561c138 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Created volume successfully. Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Acquiring lock "cinder-55303547-ab17-4195-b524-61e2e1dd0b03-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-538328d9-bc90-4fa2-9f25-b69d4f570d47-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "cinder-55303547-ab17-4195-b524-61e2e1dd0b03-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-538328d9-bc90-4fa2-9f25-b69d4f570d47-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Acquiring lock "cinder-quobyte-55303547-ab17-4195-b524-61e2e1dd0b03" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-538328d9-bc90-4fa2-9f25-b69d4f570d47" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "cinder-quobyte-55303547-ab17-4195-b524-61e2e1dd0b03" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:27 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-538328d9-bc90-4fa2-9f25-b69d4f570d47" acquired by "delete_volume" :: waited 0.039s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bb201-7641-41d0-b440-b2394650d534]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[80448164-185b-40a0-afdb-0417b17ed791]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-6b23225e-a755-4021-8092-2a285678f76b-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-6b23225e-a755-4021-8092-2a285678f76b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:28 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:28 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 Jul 09 09:41:28 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:28 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Deleting offline snapshot 6b23225e-a755-4021-8092-2a285678f76b of volume d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] snapshot_file for this snap is: volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be89211-d624-4fd3-a14b-a56825aae1d6]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:28 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:28 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:28 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.994s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:28 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f 1073741824" returned: 0 in 1.210s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f4e99442-7b5e-4004-9aa4-430ef59d7381 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-4ab44a45-6222-41a1-9f17-7df46a54ab73-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:28 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f Jul 09 09:41:28 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:28 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 0 in 0.929s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:29 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47" returned: 0 in 1.017s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:29 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47 Jul 09 09:41:29 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:29 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:29 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:29 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 0.900s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7cbb646-63f0-433b-a5df-d2bff075f792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4e08f-789d-4cad-8dfe-0182e0c3baa7]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:29 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" returned: 0 in 0.742s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3790550-b4ec-425d-a710-4f935b445699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bc3455-cd1b-4e65-abe3-bd98838d0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:29 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f (0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f): created successfully Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bc3455-cd1b-4e65-abe3-bd98838d0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (acbb17b6-9c61-4599-a7b8-c9e5202a4e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:29 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:29 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-900c51d4-bd18-4ee9-a4ab-4fcd70151f83 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:29 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 1 in 0.820s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:29 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-538328d9-bc90-4fa2-9f25-b69d4f570d47" returned: 0 in 0.731s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:29 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03 Jul 09 09:41:29 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-538328d9-bc90-4fa2-9f25-b69d4f570d47" released by "delete_volume" :: held 1.821s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['0aab1a2b-ff23-4e14-b1fb-8b35ac8f8842', 'cbf0cb6e-947a-4a63-9e5c-70ac3ced7a5e', '666c6aa1-6e88-40f3-a59a-5a80180af588', 'ff1a1d72-5d09-41a7-a85c-84daf54d42b5'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:30 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:30 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:30 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 0.845s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:30 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:30 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-3071743d-c5b3-44f8-a2a3-78f51ab08441-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-3071743d-c5b3-44f8-a2a3-78f51ab08441-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "cinder-quobyte-3071743d-c5b3-44f8-a2a3-78f51ab08441" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-3071743d-c5b3-44f8-a2a3-78f51ab08441" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f269e9b-07be-4519-89a4-c1de592aacbd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating offline snapshot d84bdbb9-13e5-4b6e-b301-6dee436b9dbc of volume 0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bb789b-b079-4ff0-b671-857c7daebb6a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:30 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-55303547-ab17-4195-b524-61e2e1dd0b03" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:30 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "cinder-quobyte-55303547-ab17-4195-b524-61e2e1dd0b03" released by "delete_volume" :: held 2.665s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:30 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Created reservations ['e702e6c6-3091-4e8e-988c-34a8b5b483e8', 'b5be02a9-14a4-4a5f-a571-8c1a2c7abc75', 'cfd31259-20cc-4b85-9a14-f294be4cca3a', '3fbd05eb-d74f-4596-b8e4-a4a09cb8a24c'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:30 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f Jul 09 09:41:30 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:30 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:30 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:30 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.975s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:30 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:30 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2b1fbaac-0fb1-4291-bda5-bc0ad48a2b5c tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-538328d9-bc90-4fa2-9f25-b69d4f570d47-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:31 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 0.998s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:31 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b Jul 09 09:41:31 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:31 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441" returned: 0 in 1.110s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:31 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441 Jul 09 09:41:31 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:31 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.878s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:31 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:31 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Deleted volume successfully. Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" returned: 0 in 1.211s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-59dcd1eb-fc8e-4480-89e3-d4751f9caef9 tempest-VolumeAndVolumeTypeFromImageTest-1950224923 None] Lock "cinder-55303547-ab17-4195-b524-61e2e1dd0b03-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:31 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc 1G Jul 09 09:41:31 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:31 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792.6b23225e-a755-4021-8092-2a285678f76b" returned: 0 in 0.865s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-6b23225e-a755-4021-8092-2a285678f76b" released by "_delete_snapshot" :: held 3.769s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" released by "delete_snapshot" :: held 3.803s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Created reservations ['94f8cb75-fc35-48d4-b899-6398931cbea7', 'cf703a76-f927-443f-b3bc-c50c4d74a576', '71c77edf-a099-4607-b2e1-7ab83b289ca5', '9f238a6b-2a45-4629-b9d7-d92bca0830cc'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:32 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Delete snapshot completed successfully. Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cb54770f-0fe9-49ba-af17-68623be66c5d tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-6b23225e-a755-4021-8092-2a285678f76b-delete_snapshot" released by "delete_snapshot" :: held 3.974s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:32 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-3071743d-c5b3-44f8-a2a3-78f51ab08441" returned: 0 in 0.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-quobyte-3071743d-c5b3-44f8-a2a3-78f51ab08441" released by "delete_volume" :: held 1.946s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Created reservations ['2c161292-184a-42d9-a05e-6e7f11f4ac81', '9672e2e3-cc58-4b48-a38c-a0c1a419aef3', 'be400761-6346-4d39-abd7-54e308723a4a', 'c789d494-2ee5-42d4-b967-1b71692e3974'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-d7cbb646-63f0-433b-a5df-d2bff075f792-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-d7cbb646-63f0-433b-a5df-d2bff075f792-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:32 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:32 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" acquired by "delete_volume" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe2cb3-ef04-4c6d-9f4a-218ea7023db9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:32 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc 1G" returned: 0 in 1.137s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:32 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:32 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:32 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc Jul 09 09:41:32 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:33 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.959s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Deleted volume successfully. Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f897ae9f-b925-4fbe-9daa-92922657d3d7 tempest-CreateVolumesFromSourceVolumeTest-295609419 None] Lock "cinder-3071743d-c5b3-44f8-a2a3-78f51ab08441-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:33 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 1.174s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:33 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" returned: 0 in 1.083s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:33 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc is being set with open permissions: ugo+rw Jul 09 09:41:33 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792 Jul 09 09:41:33 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:34 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc Jul 09 09:41:34 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:34 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d7cbb646-63f0-433b-a5df-d2bff075f792" returned: 0 in 0.963s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:34 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" returned: 0 in 0.947s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-d7cbb646-63f0-433b-a5df-d2bff075f792" released by "delete_volume" :: held 2.243s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:35 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info Jul 09 09:41:35 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Created reservations ['26de5fba-2fa1-4814-a9cf-ab7597712750', 'c17e06a9-5dd4-47b2-a2f5-39915e99b663', '0b24cecb-2e5f-4814-882f-5e4599397db0', 'a18b1945-0693-46e2-bf11-4d9727c24c0d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:35 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:35 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:35 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:35 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info is being set with open permissions: ugo+rw Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:35 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info Jul 09 09:41:35 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:35 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.741s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Deleted volume successfully. Jul 09 09:41:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-25352c70-0c9d-436c-9aaa-b5606ba109ca tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-d7cbb646-63f0-433b-a5df-d2bff075f792-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-48ac671b-311b-4ce2-a276-7fe49de87a87-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-48ac671b-311b-4ce2-a276-7fe49de87a87-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" acquired by "delete_volume" :: waited 0.029s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089150e-58d5-47bf-b752-5328eb2e96b1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:36 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 Jul 09 09:41:36 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:36 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.info" returned: 0 in 0.786s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.160s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-5b0310f7-8bf3-4651-99de-117b857acd5b tempest-CreateVolumesFromSnapshotTest-1225391074 None] Create snapshot completed successfully Jul 09 09:41:37 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87" returned: 0 in 0.985s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:37 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87 Jul 09 09:41:37 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (976c900e-ea11-48f7-a7f5-bb58d2452cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a21f07-17fd-4a69-b310-49ac634c6a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a21f07-17fd-4a69-b310-49ac634c6a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913449444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be667f-94ed-4a97-9f9b-254cf9389921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:37Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd810af5-12ab-45a1-8b36-54c473d624e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd810af5-12ab-45a1-8b36-54c473d624e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7ec188-d982-4aea-bf71-fd050e917c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7ec188-d982-4aea-bf71-fd050e917c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20be667f-94ed-4a97-9f9b-254cf9389921', 'volume_name': 'volume-20be667f-94ed-4a97-9f9b-254cf9389921', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e816525c-28b0-4c5d-b607-41b86ef96e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e816525c-28b0-4c5d-b607-41b86ef96e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8961a-6a84-40cf-b5cc-f6ddb79996bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume 20be667f-94ed-4a97-9f9b-254cf9389921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20be667f-94ed-4a97-9f9b-254cf9389921', 'volume_size': 1} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913449444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20be667f-94ed-4a97-9f9b-254cf9389921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:37Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume 20be667f-94ed-4a97-9f9b-254cf9389921 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:37 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:37 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 1073741824 Jul 09 09:41:37 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (779b561e-6cfa-4e7b-a065-e88a0bab74d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb12ac75-da1c-431a-a97b-8200418873bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb12ac75-da1c-431a-a97b-8200418873bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021076187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526e6bd-b740-4dae-af61-f92eca2be48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:38Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654cd125-7002-454a-ae5f-1b8c1afd2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654cd125-7002-454a-ae5f-1b8c1afd2356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45258b54-a351-4961-9a86-5951c050e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45258b54-a351-4961-9a86-5951c050e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7526e6bd-b740-4dae-af61-f92eca2be48c', 'volume_name': 'volume-7526e6bd-b740-4dae-af61-f92eca2be48c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67952d45-ad7d-4392-afba-a12f84c5c020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67952d45-ad7d-4392-afba-a12f84c5c020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c6187-6f2b-4690-94e8-c37c4cbfa82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume 7526e6bd-b740-4dae-af61-f92eca2be48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7526e6bd-b740-4dae-af61-f92eca2be48c', 'volume_size': 1} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:38 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-48ac671b-311b-4ce2-a276-7fe49de87a87" returned: 0 in 1.070s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-quobyte-48ac671b-311b-4ce2-a276-7fe49de87a87" released by "delete_volume" :: held 2.129s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Created reservations ['d094b742-e26c-4e08-a145-41e90d34a25f', '9ca03810-7ad3-4794-b511-b3e4888c8956', '258f77cc-48e9-4f01-8886-3fa3f5c5f242', 'c6abfc29-f520-4959-b209-738b6118522e'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (f68d67bb-676d-42ad-8871-f8d4b1d29a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac611237-e88c-4090-830c-2da986508042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac611237-e88c-4090-830c-2da986508042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908130712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48d974c-a68c-4d1b-a542-7238461fdc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:38Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bf70e9-bb8e-48d2-8714-07e981c60455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bf70e9-bb8e-48d2-8714-07e981c60455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6b0420-600a-4dda-8786-3880cfc40bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6b0420-600a-4dda-8786-3880cfc40bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48d974c-a68c-4d1b-a542-7238461fdc68', 'volume_name': 'volume-f48d974c-a68c-4d1b-a542-7238461fdc68', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d3a572-d17f-407d-9cec-e2c0b61ec11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d3a572-d17f-407d-9cec-e2c0b61ec11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255669f1-fb14-4ae1-ab56-339b481cbd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume f48d974c-a68c-4d1b-a542-7238461fdc68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48d974c-a68c-4d1b-a542-7238461fdc68', 'volume_size': 1} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (15d1bcb7-dfa5-492f-817e-66f472da9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c8738-162e-402c-8c22-b18eb0e71e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458c8738-162e-402c-8c22-b18eb0e71e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126465587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d1a9d4-9d40-403b-96c2-e1590ceb7363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:39Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6648aad-a9d3-4870-b5a0-c0d60cebf6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:38 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6648aad-a9d3-4870-b5a0-c0d60cebf6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4fa881-9f54-4796-b685-26679358718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4fa881-9f54-4796-b685-26679358718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d1a9d4-9d40-403b-96c2-e1590ceb7363', 'volume_name': 'volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5379fcd5-e0d1-4adf-bd39-b324cbf2a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5379fcd5-e0d1-4adf-bd39-b324cbf2a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e260bd6-9d21-4876-999a-259a687f656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:38 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume e1d1a9d4-9d40-403b-96c2-e1590ceb7363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363', 'volume_size': 1} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:38 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 1073741824" returned: 0 in 1.329s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:39 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 Jul 09 09:41:39 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (71e90c0d-596b-44f9-9626-8f42eb9d2ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0334de2-51e2-4131-9e7d-9f6b62082f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0334de2-51e2-4131-9e7d-9f6b62082f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268194108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c17b7b-9de3-4360-b811-0028c747d49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:39Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2977f57c-6c15-4b0d-a6da-7a0778ddeaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2977f57c-6c15-4b0d-a6da-7a0778ddeaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc76f22a-0392-471f-960f-65d397dba12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc76f22a-0392-471f-960f-65d397dba12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c17b7b-9de3-4360-b811-0028c747d49c', 'volume_name': 'volume-d8c17b7b-9de3-4360-b811-0028c747d49c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b67dec-e3a8-459e-b592-6738b44d3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b67dec-e3a8-459e-b592-6738b44d3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc08fa30-3596-425d-8759-ffe3cd4cac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume d8c17b7b-9de3-4360-b811-0028c747d49c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c17b7b-9de3-4360-b811-0028c747d49c', 'volume_size': 1} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:39 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.100s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Deleted volume successfully. Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09e36905-6692-47aa-bf94-b154565b7b0a tempest-VolumeDependencyTests-2092276504 None] Lock "cinder-48ac671b-311b-4ce2-a276-7fe49de87a87-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:39 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921" returned: 0 in 0.997s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021076187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7526e6bd-b740-4dae-af61-f92eca2be48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:38Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume 7526e6bd-b740-4dae-af61-f92eca2be48c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:40 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:40 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c 1073741824 Jul 09 09:41:40 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8961a-6a84-40cf-b5cc-f6ddb79996bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20be667f-94ed-4a97-9f9b-254cf9389921', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b47c3a-90fc-4258-861c-cb4d016c3382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-20be667f-94ed-4a97-9f9b-254cf9389921 (20be667f-94ed-4a97-9f9b-254cf9389921): created successfully Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b47c3a-90fc-4258-861c-cb4d016c3382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (976c900e-ea11-48f7-a7f5-bb58d2452cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-fdfc5d4b-bc2c-47e7-a243-15b3e278cdfa tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:41 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c 1073741824" returned: 0 in 1.246s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=115,cinder:UPDATE=175,cinder:INSERT=45,cinder:DELETE=23 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:41 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c Jul 09 09:41:41 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Flow 'volume_create_manager' (ee2d7860-3b0a-4633-9283-83986f35c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bef11f-8732-46b1-b074-c4f078752816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bef11f-8732-46b1-b074-c4f078752816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72c458-5da2-4fc7-b150-9741afeb37f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4931e0c63a4abe9ae2bf367a86007a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:41Z,use_quota=True,user_id='40aaf12ea9614bf19a5c9c06b7bb6ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e3a81a-c675-4172-9dcb-001ca4c71422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e3a81a-c675-4172-9dcb-001ca4c71422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f9fd7-cb3f-4e38-a789-e4b3362d5fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:41 devstack cinder-volume[87265]: DEBUG cinder.image.glance [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Creating Keystone auth plugin from conf {{(pid=87265) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8f9fd7-cb3f-4e38-a789-e4b3362d5fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c72c458-5da2-4fc7-b150-9741afeb37f6', 'volume_name': 'volume-0c72c458-5da2-4fc7-b150-9741afeb37f6', 'volume_size': 1, 'image_id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '671a15dc3872d268fc5b4b54c1c9bddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d4931e0c63a4abe9ae2bf367a86007a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94ee737ddc938dd87c8fe8692f7decc69f5ea8403aa0386f89d61f466e9e98af376ecf3b3de9da7895a083b7820bfd00bb9773a97125388e26c68667efb71376', 'id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'created_at': datetime.datetime(2026, 7, 9, 7, 41, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 41, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67891e-4c64-4aed-90ea-7484c4e6a85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67891e-4c64-4aed-90ea-7484c4e6a85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa4a6d-51ff-4cb4-ade3-588d03d22400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Volume 0c72c458-5da2-4fc7-b150-9741afeb37f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c72c458-5da2-4fc7-b150-9741afeb37f6', 'volume_size': 1, 'image_id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '671a15dc3872d268fc5b4b54c1c9bddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d4931e0c63a4abe9ae2bf367a86007a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94ee737ddc938dd87c8fe8692f7decc69f5ea8403aa0386f89d61f466e9e98af376ecf3b3de9da7895a083b7820bfd00bb9773a97125388e26c68667efb71376', 'id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'created_at': datetime.datetime(2026, 7, 9, 7, 41, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 41, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb/file', 'properties': {}}, 'image_service': } Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Trying to clone 0c72c458-5da2-4fc7-b150-9741afeb37f6 from image 5d184d5a-8378-48b8-a64c-c7e372ea18eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}]). {{(pid=87265) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 09:41:42 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c" returned: 0 in 0.793s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.546s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908130712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f48d974c-a68c-4d1b-a542-7238461fdc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:38Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume f48d974c-a68c-4d1b-a542-7238461fdc68 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:42 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 09:41:42 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Image download 0.00 MB at 0.00 MB/s Jul 09 09:41:42 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 1073741824 Jul 09 09:41:42 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9c6187-6f2b-4690-94e8-c37c4cbfa82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7526e6bd-b740-4dae-af61-f92eca2be48c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14d48b2-78c2-4514-8f36-911511adef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-7526e6bd-b740-4dae-af61-f92eca2be48c (7526e6bd-b740-4dae-af61-f92eca2be48c): created successfully Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14d48b2-78c2-4514-8f36-911511adef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (779b561e-6cfa-4e7b-a065-e88a0bab74d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-193d5a1b-d364-4aa8-b190-012714390a29 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4e6ff3-9cf5-489e-be6f-609aad6e0af5]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:42 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:42 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:43 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 1073741824" returned: 0 in 1.214s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:43 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 0 in 1.043s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:43 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 Jul 09 09:41:43 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:43 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:43 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Flow 'volume_create_manager' (963a2aa2-2c5d-4619-af5e-e7f1bd3ba3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec5571c-7ce1-4639-8f8a-851cc64daeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec5571c-7ce1-4639-8f8a-851cc64daeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371cf366-f20f-4dd4-b988-d2c7a62d6695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf85fc783a8414da8d4b6a9b0597f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:44Z,use_quota=True,user_id='29ec144c68554c4cbd389cd68d50a8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a2d16c-f2f9-4fe1-818f-96785cbedcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a2d16c-f2f9-4fe1-818f-96785cbedcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3be0eb-05de-49f9-bfd3-c116940007e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3be0eb-05de-49f9-bfd3-c116940007e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371cf366-f20f-4dd4-b988-d2c7a62d6695', 'volume_name': 'volume-371cf366-f20f-4dd4-b988-d2c7a62d6695', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fee3003-c456-4a6b-aad1-22d5af4c7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fee3003-c456-4a6b-aad1-22d5af4c7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3652ade2-984e-4aa3-8702-d71517601a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:43 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Volume 371cf366-f20f-4dd4-b988-d2c7a62d6695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371cf366-f20f-4dd4-b988-d2c7a62d6695', 'volume_size': 1} Jul 09 09:41:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:44 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.335s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126465587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d1a9d4-9d40-403b-96c2-e1590ceb7363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:39Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume e1d1a9d4-9d40-403b-96c2-e1590ceb7363 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:44 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255669f1-fb14-4ae1-ab56-339b481cbd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48d974c-a68c-4d1b-a542-7238461fdc68', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 1073741824 Jul 09 09:41:44 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c3d845-7a8c-4e52-bfae-5e4e2cadeb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 1 in 0.907s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Temporary image 5d184d5a-8378-48b8-a64c-c7e372ea18eb is fetched for user 40aaf12ea9614bf19a5c9c06b7bb6ed4. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 09:41:44 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-f48d974c-a68c-4d1b-a542-7238461fdc68 (f48d974c-a68c-4d1b-a542-7238461fdc68): created successfully Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c3d845-7a8c-4e52-bfae-5e4e2cadeb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (f68d67bb-676d-42ad-8871-f8d4b1d29a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f5b726b4-c3ab-4ec2-81f2-600ba082a162 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[581916e1-787c-4245-9a68-c24e078959af]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (c4ea1b81-c4ab-4cb0-8ff9-30d8f5022a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1c4b6d-0f63-489a-bc87-d3b7f4da16f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:44 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1c4b6d-0f63-489a-bc87-d3b7f4da16f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-621600649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bf5d30-5c9e-4e87-955e-888b3398747c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:45Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fa6b6b-06b4-4ef0-ba4f-3f0462c8a7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fa6b6b-06b4-4ef0-ba4f-3f0462c8a7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b366d79-cfce-47ed-b29a-0893e512d4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b366d79-cfce-47ed-b29a-0893e512d4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8bf5d30-5c9e-4e87-955e-888b3398747c', 'volume_name': 'volume-c8bf5d30-5c9e-4e87-955e-888b3398747c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cddf84-7303-4dbc-89aa-407b0ce4f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cddf84-7303-4dbc-89aa-407b0ce4f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f640ca6b-363d-44ab-987c-dadbeb92e273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:44 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Volume c8bf5d30-5c9e-4e87-955e-888b3398747c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8bf5d30-5c9e-4e87-955e-888b3398747c', 'volume_size': 1} Jul 09 09:41:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:45 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 1073741824" returned: 0 in 1.012s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:45 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 Jul 09 09:41:45 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:45 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:45 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:45 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:45 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" returned: 0 in 0.706s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.471s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268194108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c17b7b-9de3-4360-b811-0028c747d49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9924d1279f4c079c5e85df40c1af95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:39Z,use_quota=True,user_id='ded88fd992eb4fc5acc600400dd88c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Creating volume d8c17b7b-9de3-4360-b811-0028c747d49c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:46 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:46 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c 1073741824 Jul 09 09:41:46 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e260bd6-9d21-4876-999a-259a687f656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5311e3-860e-4344-977f-55a44ee1d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:46 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 (e1d1a9d4-9d40-403b-96c2-e1590ceb7363): created successfully Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5311e3-860e-4344-977f-55a44ee1d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (15d1bcb7-dfa5-492f-817e-66f472da9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c7fdd24d-ca9c-4090-9bb4-d1b92e14a842 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:46 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 1 in 0.773s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:46 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c 1073741824" returned: 0 in 0.834s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:46 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c Jul 09 09:41:46 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:47 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.771s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371cf366-f20f-4dd4-b988-d2c7a62d6695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf85fc783a8414da8d4b6a9b0597f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:44Z,use_quota=True,user_id='29ec144c68554c4cbd389cd68d50a8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Creating volume 371cf366-f20f-4dd4-b988-d2c7a62d6695 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:47 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc08fa30-3596-425d-8759-ffe3cd4cac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c17b7b-9de3-4360-b811-0028c747d49c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:47 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 1073741824 Jul 09 09:41:47 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c76bd5e-7203-4186-a5c9-9c217652dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:47 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Volume volume-d8c17b7b-9de3-4360-b811-0028c747d49c (d8c17b7b-9de3-4360-b811-0028c747d49c): created successfully Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c76bd5e-7203-4186-a5c9-9c217652dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Flow 'volume_create_manager' (71e90c0d-596b-44f9-9626-8f42eb9d2ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-26c850fc-f85a-42ab-aace-b8919ba3a8bc tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created volume successfully. Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-d8c17b7b-9de3-4360-b811-0028c747d49c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-d8c17b7b-9de3-4360-b811-0028c747d49c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-d8c17b7b-9de3-4360-b811-0028c747d49c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-d8c17b7b-9de3-4360-b811-0028c747d49c" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a85c2-fc41-4806-88ba-1f0fe6ea273b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:48 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c Jul 09 09:41:48 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:48 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 1073741824" returned: 0 in 0.953s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:48 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 Jul 09 09:41:48 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:49 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c" returned: 0 in 0.798s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:49 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:49 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:49 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.507s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-621600649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bf5d30-5c9e-4e87-955e-888b3398747c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:45Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Creating volume c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:49 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3652ade2-984e-4aa3-8702-d71517601a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371cf366-f20f-4dd4-b988-d2c7a62d6695', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc41163a-ab03-4f72-a652-a088e9323be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:49 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c 1073741824 Jul 09 09:41:49 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Volume volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 (371cf366-f20f-4dd4-b988-d2c7a62d6695): created successfully Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc41163a-ab03-4f72-a652-a088e9323be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Flow 'volume_create_manager' (963a2aa2-2c5d-4619-af5e-e7f1bd3ba3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-97811605-1b35-43c0-9916-11e6a3f40cf7 tempest-CinderUnicodeTest-1892980621 None] Created volume successfully. Jul 09 09:41:49 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-d8c17b7b-9de3-4360-b811-0028c747d49c" returned: 0 in 0.694s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-d8c17b7b-9de3-4360-b811-0028c747d49c" released by "delete_volume" :: held 1.535s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=179,cinder:SELECT=149,cinder:DELETE=12,cinder:INSERT=44 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:41:49 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['a86d9b83-ee8a-423b-8edd-a41f73bcc0d6', 'aad23aef-ea18-47e1-8cdb-1e150e73313c', 'f018c139-20a1-45b2-a8b1-3ff0248954da', '767dc3a9-305d-421a-8c66-9522471b6135'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:50 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:50 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:50 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c 1073741824" returned: 0 in 0.954s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:50 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c Jul 09 09:41:50 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-e1d1a9d4-9d40-403b-96c2-e1590ceb7363-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-e1d1a9d4-9d40-403b-96c2-e1590ceb7363-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:50 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:50 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Flow 'volume_create_manager' (ede4e2bf-f2bb-4138-af2d-038afeb5ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe72db1-b573-4ce8-9a3a-7430018aaea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe72db1-b573-4ce8-9a3a-7430018aaea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-331676186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d0e13e-188a-4471-9c66-4d1d46261261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf85fc783a8414da8d4b6a9b0597f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:51Z,use_quota=True,user_id='29ec144c68554c4cbd389cd68d50a8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c3a28e-991f-43d3-8428-73fd8edd04b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c3a28e-991f-43d3-8428-73fd8edd04b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a23bb5-b0fe-48c2-981f-352e8ba4b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a23bb5-b0fe-48c2-981f-352e8ba4b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d0e13e-188a-4471-9c66-4d1d46261261', 'volume_name': 'volume-21d0e13e-188a-4471-9c66-4d1d46261261', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c18d7d-9285-4202-9bd1-eb06de4b60d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c18d7d-9285-4202-9bd1-eb06de4b60d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d07d4-e5fa-4f92-b223-62740942699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Volume 21d0e13e-188a-4471-9c66-4d1d46261261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d0e13e-188a-4471-9c66-4d1d46261261', 'volume_size': 1} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" acquired by "delete_volume" :: waited 0.069s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641fa34-1452-414b-9fe0-0dec3eddf31c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:50 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.887s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:41:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-a2848934-be94-4871-99d8-fb7ff563838d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-d8c17b7b-9de3-4360-b811-0028c747d49c-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:50 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 Jul 09 09:41:50 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:51 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c" returned: 0 in 0.820s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.926s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72c458-5da2-4fc7-b150-9741afeb37f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4931e0c63a4abe9ae2bf367a86007a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:41Z,use_quota=True,user_id='40aaf12ea9614bf19a5c9c06b7bb6ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Creating volume 0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:51 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f640ca6b-363d-44ab-987c-dadbeb92e273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bf5d30-5c9e-4e87-955e-888b3398747c', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:51 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1073741824 Jul 09 09:41:51 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e9c74-158d-45b1-9366-2ba9a2e5a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:51 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Volume volume-c8bf5d30-5c9e-4e87-955e-888b3398747c (c8bf5d30-5c9e-4e87-955e-888b3398747c): created successfully Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e9c74-158d-45b1-9366-2ba9a2e5a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (c4ea1b81-c4ab-4cb0-8ff9-30d8f5022a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:51 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-deae2f6b-eb9b-4990-aa62-9ef89d52b832 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:41:51 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.818s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:41:51 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" returned: 0 in 0.851s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:51 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363 Jul 09 09:41:51 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:51 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1073741824" returned: 0 in 0.904s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:52 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:41:52 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:52 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" returned: 0 in 0.660s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-e1d1a9d4-9d40-403b-96c2-e1590ceb7363" released by "delete_volume" :: held 1.560s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['0c471340-19e9-42a3-9a21-7d6dab2de779', '2e94fa17-5b49-4070-a938-8c1e8d017816', 'cab931ab-dbf7-44c5-b446-cb8d94cb308e', 'b3f5a09c-2d58-43ff-8114-cd68d6a06ca7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:52 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:52 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:52 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 0 in 0.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.997s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:41:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-331676186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d0e13e-188a-4471-9c66-4d1d46261261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf85fc783a8414da8d4b6a9b0597f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:41:51Z,use_quota=True,user_id='29ec144c68554c4cbd389cd68d50a8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Creating volume 21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:41:52 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-f48d974c-a68c-4d1b-a542-7238461fdc68-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:52 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 1073741824 Jul 09 09:41:52 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-f48d974c-a68c-4d1b-a542-7238461fdc68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Attempting download of 5d184d5a-8378-48b8-a64c-c7e372ea18eb ((None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}])) to volume 0c72c458-5da2-4fc7-b150-9741afeb37f6. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-f48d974c-a68c-4d1b-a542-7238461fdc68" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-f48d974c-a68c-4d1b-a542-7238461fdc68" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7982a-b385-4316-a05c-48aede3ec851]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc57aec-b0db-42e8-b018-827a9b369e7f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:53 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9 Jul 09 09:41:53 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:53 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 Jul 09 09:41:53 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:53 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.727s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8beab3a2-ad53-4371-804a-27b57be5ea9d tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-e1d1a9d4-9d40-403b-96c2-e1590ceb7363-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:53 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68" returned: 0 in 0.838s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:53 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9" returned: 0 in 0.871s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:53 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:53 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68 Jul 09 09:41:53 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 1073741824" returned: 0 in 1.012s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:53 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 Jul 09 09:41:53 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:53 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9 Jul 09 09:41:53 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:54 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-f48d974c-a68c-4d1b-a542-7238461fdc68" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-f48d974c-a68c-4d1b-a542-7238461fdc68" released by "delete_volume" :: held 1.549s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['c8b3ba76-449c-4915-ba1f-770315c11397', '5a3747aa-a888-49b6-bbbb-809d8d901dc7', 'cc97a41b-5945-4979-86cd-004bfb033730', 'cf15e9fd-7109-43fb-8699-dc32cc7b2324'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:54 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261" returned: 0 in 0.692s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.098s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d07d4-e5fa-4f92-b223-62740942699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d0e13e-188a-4471-9c66-4d1d46261261', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9468df-1785-4090-81b4-9b1f3174dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Creating offline snapshot c6a0647f-2a69-4201-87fa-b7463dbaad97 of volume c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:41:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Volume volume-21d0e13e-188a-4471-9c66-4d1d46261261 (21d0e13e-188a-4471-9c66-4d1d46261261): created successfully Jul 09 09:41:54 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9468df-1785-4090-81b4-9b1f3174dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Flow 'volume_create_manager' (ede4e2bf-f2bb-4138-af2d-038afeb5ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3fd1f-6b6b-458f-a48b-df6b523257f9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9" returned: 1 in 0.848s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d184d5a-8378-48b8-a64c-c7e372ea18eb_88k5t5k9' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40b74c-55c3-4806-918b-f380295d6013]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-25e7d2e8-d40f-4a26-9de5-edb7d1442b5c tempest-CinderUnicodeTest-1892980621 None] Created volume successfully. Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:54 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c Jul 09 09:41:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:54 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:54 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:54 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:54 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:54 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-7526e6bd-b740-4dae-af61-f92eca2be48c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-7526e6bd-b740-4dae-af61-f92eca2be48c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-7526e6bd-b740-4dae-af61-f92eca2be48c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-7526e6bd-b740-4dae-af61-f92eca2be48c" acquired by "delete_volume" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cbb725-aae7-40a0-aeaf-2c1ce9b13049]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:55 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.865s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:55 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:55 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b0e4799d-a199-42d4-b6b8-f50ac7c6ff54 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-f48d974c-a68c-4d1b-a542-7238461fdc68-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:55 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 0 in 1.054s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:55 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c" returned: 0 in 1.180s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:55 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD Jul 09 09:41:55 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:55 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 1G Jul 09 09:41:55 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:56 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c" returned: 0 in 0.885s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:56 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c Jul 09 09:41:56 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:56 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] 5d184d5a-8378-48b8-a64c-c7e372ea18eb was raw, converting to raw {{(pid=87265) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:56 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:41:56 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:56 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 1G" returned: 0 in 0.880s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8bf5d30-5c9e-4e87-955e-888b3398747c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:56 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8bf5d30-5c9e-4e87-955e-888b3398747c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 Jul 09 09:41:56 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:56 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7526e6bd-b740-4dae-af61-f92eca2be48c" returned: 0 in 0.714s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-7526e6bd-b740-4dae-af61-f92eca2be48c" released by "delete_volume" :: held 1.668s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['37454ca6-27ce-4941-9fb8-c9a6038aa49f', '25b01aac-99b9-4d5b-8c31-afa56126f53f', '90e65f34-eb18-4653-ab0c-57496785e14e', '6fef0aed-562f-4b5a-a9e8-4c1738f04c16'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:57 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:57 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:57 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 0 in 0.843s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d184d5a-8378-48b8-a64c-c7e372ea18eb_vrcwwotxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:41:57 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:57 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1G Jul 09 09:41:57 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:57 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8bf5d30-5c9e-4e87-955e-888b3398747c -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97" returned: 0 in 0.742s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:57 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 is being set with open permissions: ugo+rw Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:57 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 Jul 09 09:41:57 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-20be667f-94ed-4a97-9f9b-254cf9389921-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-20be667f-94ed-4a97-9f9b-254cf9389921-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-20be667f-94ed-4a97-9f9b-254cf9389921" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-20be667f-94ed-4a97-9f9b-254cf9389921" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f13f48-cae8-40ab-9171-bc6342508735]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:57 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 Jul 09 09:41:57 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:57 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.813s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:57 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:41:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c53e9823-3cda-4628-91b4-2c68e18b76ec tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-7526e6bd-b740-4dae-af61-f92eca2be48c-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:58 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:58 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 1G" returned: 0 in 0.864s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:58 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info Jul 09 09:41:58 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a812f37a-3a37-4f2a-b23e-be105a4d4a3a]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:58 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:41:58 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:58 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921" returned: 0 in 0.863s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:58 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921 Jul 09 09:41:58 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:58 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:58 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info is being set with open permissions: ugo+rw Jul 09 09:41:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:58 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info Jul 09 09:41:58 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:59 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 0 in 0.816s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:59 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:41:59 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:59 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-20be667f-94ed-4a97-9f9b-254cf9389921" returned: 0 in 0.694s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-20be667f-94ed-4a97-9f9b-254cf9389921" released by "delete_volume" :: held 1.615s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['ae0654b3-126b-4fa4-90fa-0d258a78d90f', '9f0adac7-0d56-4757-843e-82395d57efd4', 'ad42e3b8-33a6-4886-a4fa-78597a48a574', '93c30031-a567-4d1b-b6a9-06b6c7e9800a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:59 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:41:59 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:59 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.info" returned: 0 in 0.694s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.117s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.107s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Creating offline snapshot ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 of volume 21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:41:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6bf6ed1a-703c-4657-9ff4-9e450b7081cd tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[70114504-377b-440c-9d67-bd989838232a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:41:59 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 Jul 09 09:41:59 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-c6a0647f-2a69-4201-87fa-b7463dbaad97-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-c6a0647f-2a69-4201-87fa-b7463dbaad97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-c6a0647f-2a69-4201-87fa-b7463dbaad97" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:41:59 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 1 in 0.833s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Downloaded image 5d184d5a-8378-48b8-a64c-c7e372ea18eb ((None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}])) to volume 0c72c458-5da2-4fc7-b150-9741afeb37f6 successfully. {{(pid=87265) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Temporary image 5d184d5a-8378-48b8-a64c-c7e372ea18eb for user 40aaf12ea9614bf19a5c9c06b7bb6ed4 is deleted. {{(pid=87265) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.volume_utils [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Marking volume 0c72c458-5da2-4fc7-b150-9741afeb37f6 as bootable. {{(pid=87265) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c6a0647f-2a69-4201-87fa-b7463dbaad97" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot c6a0647f-2a69-4201-87fa-b7463dbaad97 of volume c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:41:59 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eea065-6ff0-4268-a9ee-f6cf3c8a5d3d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Copying metadata from image 5d184d5a-8378-48b8-a64c-c7e372ea18eb to 0c72c458-5da2-4fc7-b150-9741afeb37f6. {{(pid=87265) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Creating volume glance metadata for volume 0c72c458-5da2-4fc7-b150-9741afeb37f6 backed by image 5d184d5a-8378-48b8-a64c-c7e372ea18eb with: {'image_id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '671a15dc3872d268fc5b4b54c1c9bddc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87265) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleting offline snapshot d84bdbb9-13e5-4b6e-b301-6dee436b9dbc of volume 0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] snapshot_file for this snap is: volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:00 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 Jul 09 09:42:00 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a7a9d-8bff-48c1-b294-ae71d494304f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefa4a6d-51ff-4cb4-ade3-588d03d22400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c72c458-5da2-4fc7-b150-9741afeb37f6', 'volume_size': 1, 'image_id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '671a15dc3872d268fc5b4b54c1c9bddc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2d4931e0c63a4abe9ae2bf367a86007a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94ee737ddc938dd87c8fe8692f7decc69f5ea8403aa0386f89d61f466e9e98af376ecf3b3de9da7895a083b7820bfd00bb9773a97125388e26c68667efb71376', 'id': '5d184d5a-8378-48b8-a64c-c7e372ea18eb', 'created_at': datetime.datetime(2026, 7, 9, 7, 41, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 41, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d184d5a-8378-48b8-a64c-c7e372ea18eb/file', 'properties': {}}, 'image_service': }' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a9880e-7ba3-40ec-b5bf-92da2827472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:00 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Volume volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 (0c72c458-5da2-4fc7-b150-9741afeb37f6): created successfully Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a9880e-7ba3-40ec-b5bf-92da2827472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Flow 'volume_create_manager' (ee2d7860-3b0a-4633-9283-83986f35c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-5197590b-dc8c-4742-b0a3-d64de4783e7f tempest-VolumeImageDependencyTests-1496018834 None] Created volume successfully. Jul 09 09:42:00 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc Jul 09 09:42:00 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:00 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.895s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2736f472-6d55-40b4-b03c-c5b45ab16ddd tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-20be667f-94ed-4a97-9f9b-254cf9389921-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:00 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261" returned: 0 in 1.018s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:00 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 1G Jul 09 09:42:00 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:00 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97" returned: 0 in 0.903s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8bf5d30-5c9e-4e87-955e-888b3398747c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f84cd-403e-49d9-a802-ff71d630e17f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:01 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" returned: 0 in 0.911s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:01 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c Jul 09 09:42:01 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08ddc8-a514-4de8-8b7b-c01b5b77f811]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Acquiring lock "cinder-0c72c458-5da2-4fc7-b150-9741afeb37f6-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:01 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f Jul 09 09:42:01 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "cinder-0c72c458-5da2-4fc7-b150-9741afeb37f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Acquiring lock "cinder-quobyte-0c72c458-5da2-4fc7-b150-9741afeb37f6" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "cinder-quobyte-0c72c458-5da2-4fc7-b150-9741afeb37f6" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb3ad6-f0c7-4412-9136-80301629e3bf]: (4, 'raw') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:01 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:42:01 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:01 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 1G" returned: 0 in 0.936s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d0e13e-188a-4471-9c66-4d1d46261261 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:01 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d0e13e-188a-4471-9c66-4d1d46261261 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 Jul 09 09:42:01 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:01 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c" returned: 0 in 0.925s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:01 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 Jul 09 09:42:01 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:02 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" returned: 0 in 0.974s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:02 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc Jul 09 09:42:02 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:02 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 0 in 0.875s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:02 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:42:02 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:02 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21d0e13e-188a-4471-9c66-4d1d46261261 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" returned: 0 in 0.844s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:02 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 is being set with open permissions: ugo+rw Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:02 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 Jul 09 09:42:02 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:02 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97" returned: 0 in 0.871s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:02 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97 Jul 09 09:42:02 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:03 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" returned: 0 in 0.954s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:03 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc Jul 09 09:42:03 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:03 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 1 in 0.810s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6' failed. Not Retrying. {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:03 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6 Jul 09 09:42:03 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:03 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" returned: 0 in 0.797s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:03 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info Jul 09 09:42:03 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:03 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c.c6a0647f-2a69-4201-87fa-b7463dbaad97" returned: 0 in 0.811s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c6a0647f-2a69-4201-87fa-b7463dbaad97" released by "_delete_snapshot" :: held 3.660s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" released by "delete_snapshot" :: held 3.716s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Created reservations ['4ae4f4a3-ef27-49cb-85f1-fdda9d4d95c3', '1d51d88a-ef79-4cd4-a5ab-6cb0dda8d9db', '588ff0d6-492f-4b48-a76d-fea295842fd6', '13d470d9-00d1-4ada-900c-9ce5f45847eb'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-98a3361b-554e-4c86-b235-fa1e1fbf7433 tempest-ProjectMemberTests-92145194 None] Lock "cinder-c6a0647f-2a69-4201-87fa-b7463dbaad97-delete_snapshot" released by "delete_snapshot" :: held 3.887s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0c72c458-5da2-4fc7-b150-9741afeb37f6" returned: 0 in 0.717s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "cinder-quobyte-0c72c458-5da2-4fc7-b150-9741afeb37f6" released by "delete_volume" :: held 2.481s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f.d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" returned: 0 in 0.803s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc" released by "_delete_snapshot" :: held 3.769s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" released by "delete_snapshot" :: held 3.817s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Created reservations ['b2761aee-0052-4dfc-a470-b3c24d1ce04e', 'c0aa2622-9234-47c3-91a4-a3542c0a730b', 'e13d2168-bafb-414a-b3f8-5543b509b154', '0894f378-c50b-4eb6-99b5-52a523bb97eb'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:03 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['a379b5fd-a733-4778-81bc-a92055e39821', '64f1140e-6381-4d21-b5b6-f23610fc96f5', 'f40c027d-b14b-4454-81cf-366b204d484e', '2fac9261-73ec-4304-a121-36dcb2aea833'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:04 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:04 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Delete snapshot completed successfully. Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bcb2c388-ef11-4b7d-808b-b991682d0520 tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-d84bdbb9-13e5-4b6e-b301-6dee436b9dbc-delete_snapshot" released by "delete_snapshot" :: held 4.049s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:04 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info" returned: 0 in 0.799s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:04 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info is being set with open permissions: ugo+rw Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:04 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info Jul 09 09:42:04 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-c8bf5d30-5c9e-4e87-955e-888b3398747c-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "cinder-c8bf5d30-5c9e-4e87-955e-888b3398747c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e43968-0085-4472-bd6a-026e7446969e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" acquired by "delete_volume" :: waited 0.093s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd855b42-6051-4dcc-a85b-366dc7bb73cd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:04 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c Jul 09 09:42:04 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:04 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f Jul 09 09:42:04 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:04 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.871s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:04 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Deleted volume successfully. Jul 09 09:42:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-1c613100-70ad-46ff-a347-af22204d1358 tempest-VolumeImageDependencyTests-1496018834 None] Lock "cinder-0c72c458-5da2-4fc7-b150-9741afeb37f6-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:05 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.info" returned: 0 in 0.988s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.500s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3c4c2e47-9163-4070-a628-3d24ebfb1c27 tempest-CinderUnicodeTest-1892980621 None] Create snapshot completed successfully Jul 09 09:42:05 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c" returned: 0 in 0.960s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:05 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c Jul 09 09:42:05 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:05 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" returned: 0 in 1.006s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:05 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f Jul 09 09:42:05 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-quobyte-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Deleting offline snapshot ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 of volume 21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] snapshot_file for this snap is: volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[06074039-0253-4c84-a83e-271cde13b5b0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:06 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c8bf5d30-5c9e-4e87-955e-888b3398747c" returned: 0 in 0.772s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-c8bf5d30-5c9e-4e87-955e-888b3398747c" released by "delete_volume" :: held 1.827s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:06 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" returned: 0 in 0.717s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:06 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 Jul 09 09:42:06 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-quobyte-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f" released by "delete_volume" :: held 1.811s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Created reservations ['a9280a39-29de-4b61-9a7a-522bef0efe6d', '01b7f1a1-471e-43ad-8df5-e3ff2500c649', 'bbec2e82-1ef2-47b3-80ae-f2571297be2c', '945f846c-773a-404b-9b9b-24982dee1aed'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Created reservations ['4e70729e-d437-4f85-a34f-293df9a6ccc6', 'e80fcfef-73b7-4fac-af8f-89b2ea06417a', '4980828c-f86a-49c3-93e2-5a16917e92ce', '4ba2219d-12d3-45e4-9028-618356603373'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:06 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:06 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:06 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:06 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:07 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" returned: 0 in 1.299s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21d0e13e-188a-4471-9c66-4d1d46261261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[17237dc3-1b79-480b-80f0-e0ea0eee7a9c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (b8537907-ef87-42ae-8da5-1cd74f160519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f7f4c1-646a-4882-9e48-5e2519d60aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f7f4c1-646a-4882-9e48-5e2519d60aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829530145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de269570-6a58-478c-809f-b1b89db9284e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:07Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe61b50-0ed3-4026-bbbf-9ddec710c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe61b50-0ed3-4026-bbbf-9ddec710c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab9614-215c-4ce9-9974-5fa46ab912cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddab9614-215c-4ce9-9974-5fa46ab912cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de269570-6a58-478c-809f-b1b89db9284e', 'volume_name': 'volume-de269570-6a58-478c-809f-b1b89db9284e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46b99a3-ef1c-4ef9-9de8-2dcf18d494de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46b99a3-ef1c-4ef9-9de8-2dcf18d494de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:07 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 Jul 09 09:42:07 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1737f266-710b-422d-9b3a-ac47db91d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:07 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Volume de269570-6a58-478c-809f-b1b89db9284e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de269570-6a58-478c-809f-b1b89db9284e', 'volume_size': 1} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829530145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de269570-6a58-478c-809f-b1b89db9284e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:07Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Creating volume de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:07 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:07 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.279s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:42:07 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e 1073741824 Jul 09 09:42:07 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-d003e8e3-8689-4013-b8b7-3cc0ffb1bb1c tempest-ProjectMemberTests-92145194 None] Lock "cinder-c8bf5d30-5c9e-4e87-955e-888b3398747c-delete_volume" released by "delete_volume" :: held 3.567s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:07 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 1.282s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Deleted volume successfully. Jul 09 09:42:07 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-61ee355c-ea81-4566-aa2f-73cc0c0ac10f tempest-CreateVolumesFromSnapshotTest-1225391074 None] Lock "cinder-0d8e2a27-98a2-452a-9ba2-ecbe04f46c9f-delete_volume" released by "delete_volume" :: held 3.565s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:08 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261" returned: 0 in 1.070s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:08 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 Jul 09 09:42:08 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:08 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e 1073741824" returned: 0 in 1.110s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:08 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e Jul 09 09:42:08 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:09 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:09 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2 Jul 09 09:42:09 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:09 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e" returned: 0 in 0.731s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1737f266-710b-422d-9b3a-ac47db91d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de269570-6a58-478c-809f-b1b89db9284e', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066ad470-5213-42b2-bcec-9b381537cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:09 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Volume volume-de269570-6a58-478c-809f-b1b89db9284e (de269570-6a58-478c-809f-b1b89db9284e): created successfully Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066ad470-5213-42b2-bcec-9b381537cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (b8537907-ef87-42ae-8da5-1cd74f160519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:09 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f70d9ff9-f1e0-4a7b-9cb3-8cf1629ac937 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:42:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-057e8e3a-7c3f-4f36-b274-cc7c6a2d6035 tempest-ProjectAdminTests-1330155570 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7022171020508, 'free_capacity_gb': 1775.7022171020508, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87265) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 09:42:10 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261.ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" returned: 0 in 0.656s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2" released by "_delete_snapshot" :: held 4.014s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" released by "delete_snapshot" :: held 4.060s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Created reservations ['9fd4963a-e3b8-49e5-9e56-a0495b33abf5', '84626c24-f805-436e-af08-0c5884eb7369', '5b9d5d2c-44c8-4a9f-a966-2d9d7b5c90ba', 'd16c58d1-73b3-4dce-a8e3-b0b0c48e4b16'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Delete snapshot completed successfully. Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b5887987-2956-4c1f-b4b0-749d1bcff565 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-ca4bb2a0-5edf-44b0-a43f-60ff44de6fb2-delete_snapshot" released by "delete_snapshot" :: held 4.204s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-21d0e13e-188a-4471-9c66-4d1d46261261-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-21d0e13e-188a-4471-9c66-4d1d46261261-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2408c00-6e54-48a2-933f-4ac9386d1b17]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot 601286d7-08b4-41ae-88c0-766c88159c14 of volume de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bdb6a0-3631-453f-a398-f91b75c30242]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:10 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 Jul 09 09:42:10 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:10 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e Jul 09 09:42:10 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:11 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261" returned: 0 in 0.837s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:11 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261 Jul 09 09:42:11 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:11 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e" returned: 0 in 0.882s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:11 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 1G Jul 09 09:42:11 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:12 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-21d0e13e-188a-4471-9c66-4d1d46261261" returned: 0 in 0.860s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-21d0e13e-188a-4471-9c66-4d1d46261261" released by "delete_volume" :: held 1.800s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Created reservations ['4e63057d-137e-4da5-84c7-564ba785777b', 'c961fd25-c2c9-415e-a01f-8c609f63b7fd', '26d23885-9603-4717-9fac-a4b4091d87bf', 'a682cb7a-e126-437b-9d78-87f4b8a43049'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:12 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:12 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:12 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 1G" returned: 0 in 1.026s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de269570-6a58-478c-809f-b1b89db9284e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:12 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de269570-6a58-478c-809f-b1b89db9284e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 Jul 09 09:42:12 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-371cf366-f20f-4dd4-b988-d2c7a62d6695-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-371cf366-f20f-4dd4-b988-d2c7a62d6695-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "cinder-quobyte-371cf366-f20f-4dd4-b988-d2c7a62d6695" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-371cf366-f20f-4dd4-b988-d2c7a62d6695" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6380c-c8f1-40d5-8919-06b62493fc45]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:13 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 Jul 09 09:42:13 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:13 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.901s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:13 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Deleted volume successfully. Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-568ef81d-a2fb-43ea-8f0e-8e175d42e0da tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-21d0e13e-188a-4471-9c66-4d1d46261261-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:13 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de269570-6a58-478c-809f-b1b89db9284e -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14" returned: 0 in 1.055s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:13 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 is being set with open permissions: ugo+rw Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:13 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 Jul 09 09:42:13 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:13 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695" returned: 0 in 0.940s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:13 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695 Jul 09 09:42:13 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:14 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14" returned: 0 in 0.831s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:14 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info Jul 09 09:42:14 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:14 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-371cf366-f20f-4dd4-b988-d2c7a62d6695" returned: 0 in 0.723s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-quobyte-371cf366-f20f-4dd4-b988-d2c7a62d6695" released by "delete_volume" :: held 1.718s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Created reservations ['537cbe83-9cc0-4b55-ae2c-e9da2817f2f8', '866c9d14-d06c-4398-86ff-d23d717e0b5f', '512f18e9-b3ab-4d08-9022-5991958010ca', '4c589f65-ec95-4de5-bb77-dfc3833b7c11'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:14 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:14 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:15 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info" returned: 0 in 0.874s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:15 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info is being set with open permissions: ugo+rw Jul 09 09:42:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:15 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info Jul 09 09:42:15 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:15 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.810s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:15 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Deleted volume successfully. Jul 09 09:42:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-92ad1697-e123-47cf-a0fd-6d21cbf4eb94 tempest-CinderUnicodeTest-1892980621 None] Lock "cinder-371cf366-f20f-4dd4-b988-d2c7a62d6695-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:16 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.info" returned: 0 in 0.764s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.548s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:16 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-069fa0c1-d0e0-4615-82f7-9d78411d5af3 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-601286d7-08b4-41ae-88c0-766c88159c14-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-601286d7-08b4-41ae-88c0-766c88159c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-601286d7-08b4-41ae-88c0-766c88159c14" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-601286d7-08b4-41ae-88c0-766c88159c14" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot 601286d7-08b4-41ae-88c0-766c88159c14 of volume de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2fc036-e235-4dab-870f-6cc6bb9ade4f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:17 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 Jul 09 09:42:17 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:18 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de269570-6a58-478c-809f-b1b89db9284e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767fa91-4909-4ff7-84b8-1c949ea9237d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:18 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e Jul 09 09:42:18 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:18 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e" returned: 0 in 0.819s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:18 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 Jul 09 09:42:18 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:19 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14" returned: 0 in 0.812s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:19 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14 Jul 09 09:42:19 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:20 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e.601286d7-08b4-41ae-88c0-766c88159c14" returned: 0 in 0.684s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-601286d7-08b4-41ae-88c0-766c88159c14" released by "_delete_snapshot" :: held 3.272s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" released by "delete_snapshot" :: held 3.307s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:20 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Created reservations ['735efd96-3911-4c34-add5-63bf4db79e38', 'eb6c7697-5482-4fee-93a9-d4739723039c', '8ce3d2e0-c34d-461b-b818-128aef82dd0a', '7c47249e-baa2-4a2d-af64-bb0768403d4a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:20 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:42:20 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-7ee588ce-c814-4038-b6a8-8d4c3b7ec415 tempest-ProjectMemberTests-92145194 None] Lock "cinder-601286d7-08b4-41ae-88c0-766c88159c14-delete_snapshot" released by "delete_snapshot" :: held 3.481s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-de269570-6a58-478c-809f-b1b89db9284e-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "cinder-de269570-6a58-478c-809f-b1b89db9284e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" acquired by "delete_volume" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe0aa2-6d83-45a9-93df-495d06d11344]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:21 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e Jul 09 09:42:21 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:22 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e" returned: 0 in 0.848s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:22 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e Jul 09 09:42:22 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:23 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-de269570-6a58-478c-809f-b1b89db9284e" returned: 0 in 0.751s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-de269570-6a58-478c-809f-b1b89db9284e" released by "delete_volume" :: held 1.673s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Created reservations ['22610b0a-47e1-4469-9a84-e272e55a204f', 'b50622f0-782b-4527-974f-d80f4f5b4ea2', '20bb4bc7-974c-4ac6-a6b6-7bb5644e47eb', 'd3d40530-2c70-4121-b2be-4b0c63befd90'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:23 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:23 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:24 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.955s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-e0a0a5db-f8a4-46bd-8f0d-d3ef99c24007 tempest-ProjectMemberTests-92145194 None] Lock "cinder-de269570-6a58-478c-809f-b1b89db9284e-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (3f4682d3-d85d-405c-a7d8-c9739e9b686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e57fee5-83a4-4dae-901a-c485dd57e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e57fee5-83a4-4dae-901a-c485dd57e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680293773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff5a140-b970-469d-b2e8-d67d0f9869f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:25Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a1864d-b20b-410b-b2f8-9f99e5918da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a1864d-b20b-410b-b2f8-9f99e5918da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc98de4-0c49-4da4-afe1-15d4825d3082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc98de4-0c49-4da4-afe1-15d4825d3082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff5a140-b970-469d-b2e8-d67d0f9869f8', 'volume_name': 'volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c1e71a-d9ac-42ba-a693-cdc63741e772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c1e71a-d9ac-42ba-a693-cdc63741e772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a9ed1-052e-4f36-a23d-dc9880f256b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Volume 0ff5a140-b970-469d-b2e8-d67d0f9869f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8', 'volume_size': 1} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680293773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff5a140-b970-469d-b2e8-d67d0f9869f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:25Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Creating volume 0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:24 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:24 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 1073741824 Jul 09 09:42:24 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:25 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 1073741824" returned: 0 in 1.263s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:26 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 Jul 09 09:42:26 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:26 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8" returned: 0 in 0.904s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a9ed1-052e-4f36-a23d-dc9880f256b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d2db03-9308-4e33-b523-b93f842faf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:26 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Volume volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 (0ff5a140-b970-469d-b2e8-d67d0f9869f8): created successfully Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d2db03-9308-4e33-b523-b93f842faf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:26 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (3f4682d3-d85d-405c-a7d8-c9739e9b686e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:26 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-13347502-67c7-415e-9708-8687d94303f9 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot 9951eb29-8f6f-4c96-bee6-33fe303533b6 of volume 0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffba3cb-9dab-4f36-b904-9e011171df27]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:28 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 Jul 09 09:42:28 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Flow 'volume_create_manager' (472b20e7-86a5-4ae2-abaa-2e150af2177b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba303d-28aa-4321-95b1-43e06951311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba303d-28aa-4321-95b1-43e06951311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193168756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929f3e36-6ce2-4034-9691-939094a0a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c80e7d87c74379a1a17df919dd137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:28Z,use_quota=True,user_id='47f1d9b62bba4b58ab7a360da7811a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b7ca7-71b6-429f-9331-5d7fce043430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b7ca7-71b6-429f-9331-5d7fce043430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f85dc4-1e64-4ffb-b372-d08a4ebba683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f85dc4-1e64-4ffb-b372-d08a4ebba683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929f3e36-6ce2-4034-9691-939094a0a595', 'volume_name': 'volume-929f3e36-6ce2-4034-9691-939094a0a595', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c978cd56-d3c4-4f02-9bbb-7e3b1e3bb7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c978cd56-d3c4-4f02-9bbb-7e3b1e3bb7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2c9c68-0164-4372-838e-62c0ec6ca086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:28 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Volume 929f3e36-6ce2-4034-9691-939094a0a595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929f3e36-6ce2-4034-9691-939094a0a595', 'volume_size': 1} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:28 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8" returned: 0 in 0.926s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:29 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 1G Jul 09 09:42:29 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (63dc2e7e-434d-424f-8d13-057b0ef36744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb20bb1c-e507-4952-8d02-d54f9e6f1a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb20bb1c-e507-4952-8d02-d54f9e6f1a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281702788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8537e0ad-a771-4019-85e2-d0632005494a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:29Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398ce72d-c6bf-4337-ba14-08fed21b509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398ce72d-c6bf-4337-ba14-08fed21b509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2344c8a-04bf-4782-897d-9ffbf5170382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2344c8a-04bf-4782-897d-9ffbf5170382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8537e0ad-a771-4019-85e2-d0632005494a', 'volume_name': 'volume-8537e0ad-a771-4019-85e2-d0632005494a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94ce4e-8f68-42a7-a1c2-24b4832e42f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94ce4e-8f68-42a7-a1c2-24b4832e42f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae559900-db81-46a0-9f7e-a5b7ac6272e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:29 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Volume 8537e0ad-a771-4019-85e2-d0632005494a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8537e0ad-a771-4019-85e2-d0632005494a', 'volume_size': 1} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:29 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 1G" returned: 0 in 0.901s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:29 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 Jul 09 09:42:29 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:30 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:30 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 is being set with open permissions: ugo+rw Jul 09 09:42:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:30 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 Jul 09 09:42:30 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:31 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:31 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info Jul 09 09:42:31 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:31 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info" returned: 0 in 0.659s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:31 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info is being set with open permissions: ugo+rw Jul 09 09:42:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:31 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info Jul 09 09:42:31 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:32 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.info" returned: 0 in 0.697s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.627s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193168756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929f3e36-6ce2-4034-9691-939094a0a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c80e7d87c74379a1a17df919dd137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:28Z,use_quota=True,user_id='47f1d9b62bba4b58ab7a360da7811a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Creating volume 929f3e36-6ce2-4034-9691-939094a0a595 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:32 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:32 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 1073741824 Jul 09 09:42:32 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:32 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9276da73-614c-466d-8bd5-c8f62eb79e56 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-9951eb29-8f6f-4c96-bee6-33fe303533b6-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-9951eb29-8f6f-4c96-bee6-33fe303533b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-9951eb29-8f6f-4c96-bee6-33fe303533b6" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9951eb29-8f6f-4c96-bee6-33fe303533b6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot 9951eb29-8f6f-4c96-bee6-33fe303533b6 of volume 0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5cf4d8-6dcf-4167-aa16-c0ef3239a753]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:33 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 Jul 09 09:42:33 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:33 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 1073741824" returned: 0 in 0.889s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:33 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 Jul 09 09:42:33 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:34 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6" returned: 0 in 0.777s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c445c-5175-4632-aab6-dc7dfc211394]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:34 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 Jul 09 09:42:34 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:34 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595" returned: 0 in 0.684s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281702788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8537e0ad-a771-4019-85e2-d0632005494a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:29Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Creating volume 8537e0ad-a771-4019-85e2-d0632005494a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:34 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2c9c68-0164-4372-838e-62c0ec6ca086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929f3e36-6ce2-4034-9691-939094a0a595', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:34 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a 1073741824 Jul 09 09:42:34 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f7730c-c564-4ac4-b370-110bd186c12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:34 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Volume volume-929f3e36-6ce2-4034-9691-939094a0a595 (929f3e36-6ce2-4034-9691-939094a0a595): created successfully Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f7730c-c564-4ac4-b370-110bd186c12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Flow 'volume_create_manager' (472b20e7-86a5-4ae2-abaa-2e150af2177b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3da61166-9df0-46a6-940c-8b6a4aec3106 tempest-ProjectReaderTests-2128581871 None] Created volume successfully. Jul 09 09:42:34 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8" returned: 0 in 0.766s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:34 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 Jul 09 09:42:34 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Acquiring lock "cinder-929f3e36-6ce2-4034-9691-939094a0a595-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "cinder-929f3e36-6ce2-4034-9691-939094a0a595-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:35 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a 1073741824" returned: 0 in 0.865s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Acquiring lock "cinder-quobyte-929f3e36-6ce2-4034-9691-939094a0a595" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "cinder-quobyte-929f3e36-6ce2-4034-9691-939094a0a595" acquired by "delete_volume" :: waited 0.034s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:35 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a Jul 09 09:42:35 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[29482912-4a44-4b12-bd75-8ab4c3544461]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:35 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 Jul 09 09:42:35 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:35 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:35 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6 Jul 09 09:42:35 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:35 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a" returned: 0 in 0.712s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae559900-db81-46a0-9f7e-a5b7ac6272e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8537e0ad-a771-4019-85e2-d0632005494a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d71046-8b5c-4338-b771-f5a6e6d97343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Volume volume-8537e0ad-a771-4019-85e2-d0632005494a (8537e0ad-a771-4019-85e2-d0632005494a): created successfully Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d71046-8b5c-4338-b771-f5a6e6d97343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (63dc2e7e-434d-424f-8d13-057b0ef36744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-eec23d14-2ee0-46bd-b3f7-7bb348c428b6 tempest-ProjectReaderTests-1621470616 None] Created volume successfully. Jul 09 09:42:36 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595" returned: 0 in 0.862s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:36 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595 Jul 09 09:42:36 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:36 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8.9951eb29-8f6f-4c96-bee6-33fe303533b6" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9951eb29-8f6f-4c96-bee6-33fe303533b6" released by "_delete_snapshot" :: held 3.079s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" released by "delete_snapshot" :: held 3.109s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Created reservations ['c25a1c7d-bdc5-47a2-a569-7ffac006c84f', '75fed7b8-9011-42b9-9c64-7aa3d05773dd', 'eb73a9d3-e523-4962-8705-83f92c3f1bfc', '20ca84f4-c82e-4f9c-a2db-8b1939e473da'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:36 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-10972494-981b-48ef-8f27-a531f764540b tempest-ProjectMemberTests-92145194 None] Lock "cinder-9951eb29-8f6f-4c96-bee6-33fe303533b6-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:36 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-929f3e36-6ce2-4034-9691-939094a0a595" returned: 0 in 0.663s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "cinder-quobyte-929f3e36-6ce2-4034-9691-939094a0a595" released by "delete_volume" :: held 1.573s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Created reservations ['376afbc8-defc-4cb1-a708-f017683683c8', '6a639b6c-15a0-4c78-82fe-0217e04fd063', '53b41e8d-def0-4de9-8ae5-22515e96ced8', 'cee87cce-64c3-4074-90a6-69726338396d'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:36 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:36 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-8537e0ad-a771-4019-85e2-d0632005494a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-8537e0ad-a771-4019-85e2-d0632005494a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-quobyte-8537e0ad-a771-4019-85e2-d0632005494a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-8537e0ad-a771-4019-85e2-d0632005494a" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec111e-85e9-4e3a-8b25-b28aa8e39040]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:37 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a Jul 09 09:42:37 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-0ff5a140-b970-469d-b2e8-d67d0f9869f8-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "cinder-0ff5a140-b970-469d-b2e8-d67d0f9869f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:37 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Deleted volume successfully. Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc25c7-42d3-4a9c-be7d-3c50b0c4bc97]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-695c3c2d-e3a6-4633-856e-15e69b51bff8 tempest-ProjectReaderTests-2128581871 None] Lock "cinder-929f3e36-6ce2-4034-9691-939094a0a595-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:37 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 Jul 09 09:42:37 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Flow 'volume_create_manager' (ee4aafc3-e613-4f6e-bb1c-a0435ea14f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea63735-31b3-4b49-84a2-a63616112bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea63735-31b3-4b49-84a2-a63616112bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282832480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bd61b0-1698-4433-b26c-b0f962a55dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c80e7d87c74379a1a17df919dd137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:38Z,use_quota=True,user_id='47f1d9b62bba4b58ab7a360da7811a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4697310-db93-4fa1-83c6-b879281196ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4697310-db93-4fa1-83c6-b879281196ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f0a63e-1dbc-489d-95f0-e7b1150dc5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f0a63e-1dbc-489d-95f0-e7b1150dc5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bd61b0-1698-4433-b26c-b0f962a55dd1', 'volume_name': 'volume-68bd61b0-1698-4433-b26c-b0f962a55dd1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc0e1f-98cf-4d56-8626-f52d860def0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc0e1f-98cf-4d56-8626-f52d860def0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ede649-b9c3-40e7-aac9-aefc71a056f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Volume 68bd61b0-1698-4433-b26c-b0f962a55dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bd61b0-1698-4433-b26c-b0f962a55dd1', 'volume_size': 1} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282832480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bd61b0-1698-4433-b26c-b0f962a55dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c80e7d87c74379a1a17df919dd137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:38Z,use_quota=True,user_id='47f1d9b62bba4b58ab7a360da7811a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Creating volume 68bd61b0-1698-4433-b26c-b0f962a55dd1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:37 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:37 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a" returned: 0 in 0.876s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:38 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 1073741824 Jul 09 09:42:38 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:38 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a Jul 09 09:42:38 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:38 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8" returned: 0 in 0.802s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:38 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8 Jul 09 09:42:38 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:38 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-8537e0ad-a771-4019-85e2-d0632005494a" returned: 0 in 0.688s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-8537e0ad-a771-4019-85e2-d0632005494a" released by "delete_volume" :: held 1.606s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Created reservations ['6bb8a104-eb12-4297-9370-1d90caa941ed', '2213665e-9540-42c3-90c8-5cf2a5c3608a', '37c3499e-a43d-4536-96e3-5eaf7e8c16b7', '1afc3578-0f5c-4911-b35d-0cbf8fc9277b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:38 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 1073741824" returned: 0 in 0.886s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:38 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:38 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:38 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 Jul 09 09:42:38 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:39 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-0ff5a140-b970-469d-b2e8-d67d0f9869f8" returned: 0 in 0.722s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-0ff5a140-b970-469d-b2e8-d67d0f9869f8" released by "delete_volume" :: held 1.610s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Created reservations ['8b16eef5-9193-402e-a972-3923ba033754', 'e2e30ba6-1560-47e4-950d-deb26bb512c9', '2e86fe64-4724-465a-a509-8883d4e3412a', 'f84e257c-9a19-4015-9b31-87289babdd8b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:39 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:39 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:39 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:39 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1" returned: 0 in 0.735s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Deleted volume successfully. Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ede649-b9c3-40e7-aac9-aefc71a056f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bd61b0-1698-4433-b26c-b0f962a55dd1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a82290c-4c69-43e5-879e-7b508be349fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Volume volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 (68bd61b0-1698-4433-b26c-b0f962a55dd1): created successfully Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a82290c-4c69-43e5-879e-7b508be349fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Flow 'volume_create_manager' (ee4aafc3-e613-4f6e-bb1c-a0435ea14f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b7445a16-9657-4137-992b-9e11f58c3e51 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-8537e0ad-a771-4019-85e2-d0632005494a-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c3208510-7e67-481f-91ab-bf58c088cb2f tempest-ProjectReaderTests-2128581871 None] Created volume successfully. Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (e2d7257a-79ae-47a5-8ebc-dbcecc5bca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69fafca-0d31-4851-8fa2-935d228fdd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69fafca-0d31-4851-8fa2-935d228fdd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330724748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4ab9af-dc44-4ae9-aeac-88882425bfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:40Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b120b9bb-34eb-4d7d-93d0-ad509d344170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b120b9bb-34eb-4d7d-93d0-ad509d344170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb2083-86e1-4761-978b-c0f8219026b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb2083-86e1-4761-978b-c0f8219026b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4ab9af-dc44-4ae9-aeac-88882425bfcd', 'volume_name': 'volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bc5d6a-ff8b-4c52-ba8e-4f3c5d222cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bc5d6a-ff8b-4c52-ba8e-4f3c5d222cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12998637-0007-4be5-9c8c-dd92852d23f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:39 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Volume 2e4ab9af-dc44-4ae9-aeac-88882425bfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd', 'volume_size': 1} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330724748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4ab9af-dc44-4ae9-aeac-88882425bfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:40Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Creating volume 2e4ab9af-dc44-4ae9-aeac-88882425bfcd {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:39 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:39 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd 1073741824 Jul 09 09:42:39 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Acquiring lock "cinder-68bd61b0-1698-4433-b26c-b0f962a55dd1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "cinder-68bd61b0-1698-4433-b26c-b0f962a55dd1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Acquiring lock "cinder-quobyte-68bd61b0-1698-4433-b26c-b0f962a55dd1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "cinder-quobyte-68bd61b0-1698-4433-b26c-b0f962a55dd1" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf85d5-6a32-412b-9671-dc136650d8b9]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:40 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.885s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:40 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:42:40 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 Jul 09 09:42:40 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (f2163c0a-4511-4f94-a9fe-1e89081cce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868b0316-96fa-46f5-b851-85a030d90027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868b0316-96fa-46f5-b851-85a030d90027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388495606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6275ab-4e80-4b67-991b-12a6518bf488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:40Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d205d3e-c585-4aea-9f92-0f1dae1188a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d205d3e-c585-4aea-9f92-0f1dae1188a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd4a82e-f0c9-44ec-9690-7ea8a18db51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd4a82e-f0c9-44ec-9690-7ea8a18db51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6275ab-4e80-4b67-991b-12a6518bf488', 'volume_name': 'volume-cb6275ab-4e80-4b67-991b-12a6518bf488', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebb2974-9764-4811-a578-0496db5b5a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebb2974-9764-4811-a578-0496db5b5a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa43764-107c-407e-adf1-e4260ac0e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Volume cb6275ab-4e80-4b67-991b-12a6518bf488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6275ab-4e80-4b67-991b-12a6518bf488', 'volume_size': 1} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-723d1c84-bb8d-4804-a296-569177fd522c tempest-ProjectMemberTests-92145194 None] Lock "cinder-0ff5a140-b970-469d-b2e8-d67d0f9869f8-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:40 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd 1073741824" returned: 0 in 0.912s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:40 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd Jul 09 09:42:40 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:41 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1" returned: 0 in 0.853s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:41 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1 Jul 09 09:42:41 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:41 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" returned: 0 in 0.637s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388495606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6275ab-4e80-4b67-991b-12a6518bf488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:40Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Creating volume cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:41 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=199,cinder:SELECT=139,cinder:DELETE=11,cinder:INSERT=57 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12998637-0007-4be5-9c8c-dd92852d23f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:41 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 1073741824 Jul 09 09:42:41 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656455d4-33c7-42e8-b083-3e9e26b22703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:41 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Volume volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd (2e4ab9af-dc44-4ae9-aeac-88882425bfcd): created successfully Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656455d4-33c7-42e8-b083-3e9e26b22703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (e2d7257a-79ae-47a5-8ebc-dbcecc5bca17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:41 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0131f394-2066-41a1-8e51-c381637f8fd7 tempest-ProjectReaderTests-1621470616 None] Created volume successfully. Jul 09 09:42:41 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-68bd61b0-1698-4433-b26c-b0f962a55dd1" returned: 0 in 0.698s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "cinder-quobyte-68bd61b0-1698-4433-b26c-b0f962a55dd1" released by "delete_volume" :: held 1.613s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Created reservations ['edc36528-04fa-4192-9bf5-28c3b3a206dc', '0a01b446-324a-490c-aa62-898ff34c71a6', 'fd3dad4f-9c9b-4778-93fc-f211f40cdaf7', '585f6f96-f4fd-4a10-9b9a-5d43dd3c5d91'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-2e4ab9af-dc44-4ae9-aeac-88882425bfcd-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:41 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:41 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-2e4ab9af-dc44-4ae9-aeac-88882425bfcd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-quobyte-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:41 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b1791-c178-4644-90bf-30b89a92092a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:42 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd Jul 09 09:42:42 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:42 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 1073741824" returned: 0 in 0.837s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:42 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 Jul 09 09:42:42 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:42 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.818s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Deleted volume successfully. Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-4c616dcc-1f9f-4a0c-9cf9-cf550c520d9f tempest-ProjectReaderTests-2128581871 None] Lock "cinder-68bd61b0-1698-4433-b26c-b0f962a55dd1-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:42 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" returned: 0 in 0.889s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:42 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd Jul 09 09:42:42 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:43 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488" returned: 0 in 0.731s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa43764-107c-407e-adf1-e4260ac0e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6275ab-4e80-4b67-991b-12a6518bf488', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0835a8ab-dec6-4a34-b68f-9435e52be961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:43 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Volume volume-cb6275ab-4e80-4b67-991b-12a6518bf488 (cb6275ab-4e80-4b67-991b-12a6518bf488): created successfully Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0835a8ab-dec6-4a34-b68f-9435e52be961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (f2163c0a-4511-4f94-a9fe-1e89081cce47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-9be19ce9-0576-40e7-9d69-f5b1352b9f7f tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:42:43 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" returned: 0 in 0.730s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-2e4ab9af-dc44-4ae9-aeac-88882425bfcd" released by "delete_volume" :: held 1.673s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Created reservations ['6d06158a-a203-433e-ab3c-3b0c96e2cf14', '90a58533-eb14-42d9-9123-93d2116a1946', '9bc28166-fcd5-4f09-8a1d-512e17f716b4', '3765824a-c12b-48fd-8140-e8e01a3f72f8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Creating offline snapshot 3fd74a7c-a174-48a2-904f-9ebb33c13c29 of volume cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a8e30-fa54-447d-bcc5-1e6513856e81]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:43 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:43 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:43 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 Jul 09 09:42:43 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:44 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:44 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Deleted volume successfully. Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:44 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (0513bf54-683f-4a37-a484-73b6dc5990b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2487d17b-d1cf-4f20-848d-befc2f81d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488" returned: 0 in 0.914s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2487d17b-d1cf-4f20-848d-befc2f81d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335173922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49b5188-2ce0-4d4d-bfcd-9713480917c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:45Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ce4c0b-b52b-4ecf-8ca0-b205c3dd667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ce4c0b-b52b-4ecf-8ca0-b205c3dd667d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:44 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 1G Jul 09 09:42:44 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d7c3c-591c-41f7-b518-f40a4272067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d7c3c-591c-41f7-b518-f40a4272067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49b5188-2ce0-4d4d-bfcd-9713480917c0', 'volume_name': 'volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cefc4a1-903b-4108-ad8e-7a67dffe8f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cefc4a1-903b-4108-ad8e-7a67dffe8f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f9d39-d54b-4414-8762-7df2e10b33cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:44 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Volume b49b5188-2ce0-4d4d-bfcd-9713480917c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0', 'volume_size': 1} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-c0e83688-6a2d-4103-a9d4-7dba7e086897 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-2e4ab9af-dc44-4ae9-aeac-88882425bfcd-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:45 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 1G" returned: 0 in 0.804s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6275ab-4e80-4b67-991b-12a6518bf488 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:45 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6275ab-4e80-4b67-991b-12a6518bf488 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 Jul 09 09:42:45 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:46 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6275ab-4e80-4b67-991b-12a6518bf488 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:46 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 is being set with open permissions: ugo+rw Jul 09 09:42:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:46 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 Jul 09 09:42:46 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:46 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29" returned: 0 in 0.638s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:46 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info Jul 09 09:42:46 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:47 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info" returned: 0 in 0.639s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:47 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info is being set with open permissions: ugo+rw Jul 09 09:42:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:47 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info Jul 09 09:42:47 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:48 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.info" returned: 0 in 0.638s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.376s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335173922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49b5188-2ce0-4d4d-bfcd-9713480917c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:45Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Creating volume b49b5188-2ce0-4d4d-bfcd-9713480917c0 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:48 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:48 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 1073741824 Jul 09 09:42:48 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-39c488cf-6c5b-43d0-bdcd-73dbb1eec47b tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-3fd74a7c-a174-48a2-904f-9ebb33c13c29-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:48 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-3fd74a7c-a174-48a2-904f-9ebb33c13c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 1073741824" returned: 0 in 0.820s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-3fd74a7c-a174-48a2-904f-9ebb33c13c29" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-3fd74a7c-a174-48a2-904f-9ebb33c13c29" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot 3fd74a7c-a174-48a2-904f-9ebb33c13c29 of volume cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478f9ac-b409-45d1-80ba-f4c31116d8aa]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:49 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 Jul 09 09:42:49 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:49 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 Jul 09 09:42:49 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:49 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0" returned: 0 in 0.658s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1f9d39-d54b-4414-8762-7df2e10b33cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799ba3cd-afb8-41f6-8f33-38d24e345eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Volume volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 (b49b5188-2ce0-4d4d-bfcd-9713480917c0): created successfully Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799ba3cd-afb8-41f6-8f33-38d24e345eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (0513bf54-683f-4a37-a484-73b6dc5990b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:49 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-c9104e2a-be69-480d-858e-3d0635c203b7 tempest-ProjectReaderTests-1621470616 None] Created volume successfully. Jul 09 09:42:49 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29" returned: 0 in 0.759s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb6275ab-4e80-4b67-991b-12a6518bf488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[655b61d7-5062-4a2d-a831-a19c69bc1d9b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-b49b5188-2ce0-4d4d-bfcd-9713480917c0-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:49 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 Jul 09 09:42:49 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "cinder-b49b5188-2ce0-4d4d-bfcd-9713480917c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:49 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=187,cinder:SELECT=148,cinder:DELETE=20,cinder:INSERT=49 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-quobyte-b49b5188-2ce0-4d4d-bfcd-9713480917c0" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-b49b5188-2ce0-4d4d-bfcd-9713480917c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d12811-539a-4615-b1d3-76631dd4a46a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:50 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 Jul 09 09:42:50 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:50 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:50 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:50 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:50 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 Jul 09 09:42:50 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:50 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0" returned: 0 in 0.765s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:50 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0 Jul 09 09:42:50 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:51 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:42:51 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29" returned: 0 in 0.808s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:51 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29 Jul 09 09:42:51 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:51 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b49b5188-2ce0-4d4d-bfcd-9713480917c0" returned: 0 in 0.690s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-b49b5188-2ce0-4d4d-bfcd-9713480917c0" released by "delete_volume" :: held 1.491s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Created reservations ['2f4d841d-a55f-41e7-bdc4-c21cc838e08b', '9054c75c-9341-4dca-ac2f-2b50d6ded23b', '48a3b5aa-5e98-4e0a-aa6b-2e51474b827b', '0afd3bc2-d149-4e98-ae1c-3e760502e5f0'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:51 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:51 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:52 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488.3fd74a7c-a174-48a2-904f-9ebb33c13c29" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-3fd74a7c-a174-48a2-904f-9ebb33c13c29" released by "_delete_snapshot" :: held 3.077s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" released by "delete_snapshot" :: held 3.110s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Created reservations ['afe32586-9f52-4a73-89c4-ed284a028df3', '85967cad-535d-4acb-a7a8-6f98a2b57624', 'd6feeaab-ebf2-4a1b-b4d8-6881bed41e30', 'ae442cb9-b75e-4cbf-b78c-d48099b15c32'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-288ae9a4-236c-450e-9b40-b9bd4dbbc43f tempest-ProjectMemberTests-92145194 None] Lock "cinder-3fd74a7c-a174-48a2-904f-9ebb33c13c29-delete_snapshot" released by "delete_snapshot" :: held 3.271s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:52 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.652s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:52 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Deleted volume successfully. Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0126881d-0643-4392-9d51-4f7c65bb058d tempest-ProjectReaderTests-1621470616 None] Lock "cinder-b49b5188-2ce0-4d4d-bfcd-9713480917c0-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (5d174a6a-36e0-4120-bcdf-e6622bfeb777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9165b985-2948-4d92-b545-d969a75e6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9165b985-2948-4d92-b545-d969a75e6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1527406255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d35490-b5be-4b90-b45d-337f94fb33b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:53Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381b6691-9802-41a6-b418-9aa8d99af8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381b6691-9802-41a6-b418-9aa8d99af8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f987aa-8f0a-4b0e-836c-09850eaba7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f987aa-8f0a-4b0e-836c-09850eaba7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d35490-b5be-4b90-b45d-337f94fb33b9', 'volume_name': 'volume-19d35490-b5be-4b90-b45d-337f94fb33b9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe2759c-6506-41b8-a0bd-1560ffcafce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe2759c-6506-41b8-a0bd-1560ffcafce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e28be-4431-410d-8c48-8e4222962f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:52 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Volume 19d35490-b5be-4b90-b45d-337f94fb33b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d35490-b5be-4b90-b45d-337f94fb33b9', 'volume_size': 1} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1527406255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d35490-b5be-4b90-b45d-337f94fb33b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02be97fb4cb4284965ad349b255ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:53Z,use_quota=True,user_id='be50c8c4d26941fc9b11193d20b9e3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Creating volume 19d35490-b5be-4b90-b45d-337f94fb33b9 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:52 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:52 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 1073741824 Jul 09 09:42:52 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-cb6275ab-4e80-4b67-991b-12a6518bf488-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "cinder-cb6275ab-4e80-4b67-991b-12a6518bf488-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3257815-4e45-492e-841e-90ec58dbb1c2]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:53 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 Jul 09 09:42:53 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:53 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 1073741824" returned: 0 in 0.870s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:53 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 Jul 09 09:42:53 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:54 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488" returned: 0 in 0.794s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:54 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488 Jul 09 09:42:54 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:54 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9" returned: 0 in 0.650s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e28be-4431-410d-8c48-8e4222962f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d35490-b5be-4b90-b45d-337f94fb33b9', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728786f9-7449-4635-bd10-0a47aa0c9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:54 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Volume volume-19d35490-b5be-4b90-b45d-337f94fb33b9 (19d35490-b5be-4b90-b45d-337f94fb33b9): created successfully Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728786f9-7449-4635-bd10-0a47aa0c9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Flow 'volume_create_manager' (5d174a6a-36e0-4120-bcdf-e6622bfeb777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:54 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7cf9ff9b-0fbf-4559-8982-1d429080828d tempest-ProjectReaderTests-1621470616 None] Created volume successfully. Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-19d35490-b5be-4b90-b45d-337f94fb33b9-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-19d35490-b5be-4b90-b45d-337f94fb33b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "cinder-quobyte-19d35490-b5be-4b90-b45d-337f94fb33b9" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:42:54 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-cb6275ab-4e80-4b67-991b-12a6518bf488" returned: 0 in 0.652s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-cb6275ab-4e80-4b67-991b-12a6518bf488" released by "delete_volume" :: held 1.508s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-19d35490-b5be-4b90-b45d-337f94fb33b9" acquired by "delete_volume" :: waited 0.032s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be6514-9bf6-4a2e-8051-849c9cd78c16]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Created reservations ['865ef801-decc-4c5f-a508-e721338f1e4e', 'e52da8fb-660a-49c2-9603-8c30e9bf7c13', '7da99046-2dad-4c80-826f-a20cb36084c9', '737062c9-161f-42b3-bb85-2197042a57e2'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:54 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 Jul 09 09:42:54 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:55 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:55 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:55 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9" returned: 0 in 0.765s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:55 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9 Jul 09 09:42:55 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:55 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.715s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-b87c40a2-5fa7-4bb8-8866-3502cc4c5012 tempest-ProjectMemberTests-92145194 None] Lock "cinder-cb6275ab-4e80-4b67-991b-12a6518bf488-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:42:55 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (66b2a4ff-d43d-4dd0-adda-db687700bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c1bbd9-93a2-4f14-acbb-aaf6e0ed1b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c1bbd9-93a2-4f14-acbb-aaf6e0ed1b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303389960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d733cf1-ead0-4644-a2b2-37c0b463e2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:56Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476c637f-a756-4fee-9476-113d62f494e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476c637f-a756-4fee-9476-113d62f494e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03398972-e1de-4d02-b32e-987348c7e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03398972-e1de-4d02-b32e-987348c7e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d733cf1-ead0-4644-a2b2-37c0b463e2c1', 'volume_name': 'volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b514d60-2727-4664-a585-503c3677514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b514d60-2727-4664-a585-503c3677514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34af12a0-7218-4cf2-b625-b2e47b36e0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Volume 9d733cf1-ead0-4644-a2b2-37c0b463e2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1', 'volume_size': 1} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303389960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d733cf1-ead0-4644-a2b2-37c0b463e2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:42:56Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Creating volume 9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:42:56 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:56 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 1073741824 Jul 09 09:42:56 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:56 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-19d35490-b5be-4b90-b45d-337f94fb33b9" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-quobyte-19d35490-b5be-4b90-b45d-337f94fb33b9" released by "delete_volume" :: held 1.445s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Created reservations ['bbc5eff4-7f9b-4373-8c7a-21627d3d9b4d', 'e415cefd-8a01-4a0b-8062-45a9d8d0d016', 'b1a21dd4-eba1-41a6-afad-4d8501f06b41', '7f77ca58-db87-44a9-8955-2be905a73d75'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:56 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:42:56 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:56 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 1073741824" returned: 0 in 0.836s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:56 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 Jul 09 09:42:56 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:57 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.667s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:42:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Deleted volume successfully. Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2665a661-0c3b-499f-9dd7-5274004c2754 tempest-ProjectReaderTests-1621470616 None] Lock "cinder-19d35490-b5be-4b90-b45d-337f94fb33b9-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:42:57 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" returned: 0 in 0.647s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34af12a0-7218-4cf2-b625-b2e47b36e0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80754cae-9997-4728-b295-25b274bfb54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:42:57 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Volume volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 (9d733cf1-ead0-4644-a2b2-37c0b463e2c1): created successfully Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80754cae-9997-4728-b295-25b274bfb54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:42:57 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (66b2a4ff-d43d-4dd0-adda-db687700bc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:42:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f4cd7226-e255-41da-b4d2-934d7e4856b4 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:42:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:42:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:42:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot d3d88ba1-e21a-477a-aec8-26639779ab63 of volume 9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:42:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e0e1e1-d593-4390-827e-c103e1d83990]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:42:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:58 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 Jul 09 09:42:58 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:59 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:59 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 1G Jul 09 09:42:59 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:42:59 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 09 09:42:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 1G" returned: 0 in 0.786s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:42:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:42:59 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 Jul 09 09:42:59 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:00 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63" returned: 0 in 0.663s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:00 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 is being set with open permissions: ugo+rw Jul 09 09:43:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:00 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 Jul 09 09:43:00 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:01 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63" returned: 0 in 0.622s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:01 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info Jul 09 09:43:01 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:01 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info" returned: 0 in 0.641s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:01 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info is being set with open permissions: ugo+rw Jul 09 09:43:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:01 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info Jul 09 09:43:01 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:02 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.info" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.209s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1c4d9426-2a5a-45ad-9280-c836206a4fc5 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-d3d88ba1-e21a-477a-aec8-26639779ab63-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-d3d88ba1-e21a-477a-aec8-26639779ab63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-d3d88ba1-e21a-477a-aec8-26639779ab63" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-d3d88ba1-e21a-477a-aec8-26639779ab63" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot d3d88ba1-e21a-477a-aec8-26639779ab63 of volume 9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f19c1-a00f-4ba2-ae74-10b097430778]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:03 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 Jul 09 09:43:03 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:04 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63" returned: 0 in 0.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:43:04 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a00a08-2aa1-487e-ace4-2e6799d9852c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:04 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 Jul 09 09:43:04 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:05 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:05 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 Jul 09 09:43:05 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:05 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:05 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63 Jul 09 09:43:05 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:06 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1.d3d88ba1-e21a-477a-aec8-26639779ab63" returned: 0 in 0.638s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-d3d88ba1-e21a-477a-aec8-26639779ab63" released by "_delete_snapshot" :: held 2.919s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" released by "delete_snapshot" :: held 2.941s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Created reservations ['30be2e18-1a40-4001-93d6-e5d9c457cf35', '2ffee84a-da6a-451b-9aa2-1a6e6263f061', 'e7b40f07-b2b4-47aa-806a-813b81c9d473', '4a55c389-f5f4-45e0-9120-d97865cdd833'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:06 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-78d36b4d-ac88-498f-b745-0149b8549142 tempest-ProjectMemberTests-92145194 None] Lock "cinder-d3d88ba1-e21a-477a-aec8-26639779ab63-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-9d733cf1-ead0-4644-a2b2-37c0b463e2c1-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "cinder-9d733cf1-ead0-4644-a2b2-37c0b463e2c1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[846010b9-e901-44b7-a975-93ddaa56ab6c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:06 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 Jul 09 09:43:06 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:07 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:07 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1 Jul 09 09:43:07 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:08 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-9d733cf1-ead0-4644-a2b2-37c0b463e2c1" released by "delete_volume" :: held 1.439s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Created reservations ['3138e356-aa8c-4acf-8d41-d506162a1409', '4bd930cb-ef60-4df4-a021-81d7ea303c4e', '5e58e170-bb09-4fe1-991f-85d79772d298', '2cd0b238-2e11-4339-8da0-c5053d828782'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:08 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:43:08 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:08 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.642s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:43:08 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:43:08 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-abc1d366-b417-4e7d-ba68-216567987e03 tempest-ProjectMemberTests-92145194 None] Lock "cinder-9d733cf1-ead0-4644-a2b2-37c0b463e2c1-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (29db4288-8e92-4ce2-b452-3bd0caf233e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8465243d-b93e-4b9c-9777-f2beb49f2074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8465243d-b93e-4b9c-9777-f2beb49f2074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465716362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af720623-63d0-41fa-85c6-db60c3fe6804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:09Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0b379d-ed02-49ed-a3c1-fabf8a41eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0b379d-ed02-49ed-a3c1-fabf8a41eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b03168f-21d8-4f4b-b123-f91ee7a49b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b03168f-21d8-4f4b-b123-f91ee7a49b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af720623-63d0-41fa-85c6-db60c3fe6804', 'volume_name': 'volume-af720623-63d0-41fa-85c6-db60c3fe6804', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c3c8c5-1ca4-4cb4-9122-c540979b8b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c3c8c5-1ca4-4cb4-9122-c540979b8b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10f76cd-0e95-4b19-a7ad-f58192820d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:09 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Volume af720623-63d0-41fa-85c6-db60c3fe6804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af720623-63d0-41fa-85c6-db60c3fe6804', 'volume_size': 1} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465716362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af720623-63d0-41fa-85c6-db60c3fe6804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:09Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Creating volume af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:43:09 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:43:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:09 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 1073741824 Jul 09 09:43:09 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:10 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 1073741824" returned: 0 in 0.784s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:10 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 Jul 09 09:43:10 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:10 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10f76cd-0e95-4b19-a7ad-f58192820d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af720623-63d0-41fa-85c6-db60c3fe6804', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7874178c-318a-420b-a7e0-b613cf82e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:10 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Volume volume-af720623-63d0-41fa-85c6-db60c3fe6804 (af720623-63d0-41fa-85c6-db60c3fe6804): created successfully Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7874178c-318a-420b-a7e0-b613cf82e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:10 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (29db4288-8e92-4ce2-b452-3bd0caf233e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:10 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3e1fb641-c98a-4d7f-891b-24b15c0a3726 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:43:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:11 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot f110c289-f0fb-4885-8509-2355e368a20a of volume af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:43:11 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec96cc-25f9-416c-94ab-9f50b86cd373]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:11 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 Jul 09 09:43:11 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:12 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:12 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a 1G Jul 09 09:43:12 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:13 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a 1G" returned: 0 in 0.763s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af720623-63d0-41fa-85c6-db60c3fe6804 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:13 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af720623-63d0-41fa-85c6-db60c3fe6804 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a Jul 09 09:43:13 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:13 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af720623-63d0-41fa-85c6-db60c3fe6804 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a" returned: 0 in 0.695s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:13 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a is being set with open permissions: ugo+rw Jul 09 09:43:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:13 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a Jul 09 09:43:13 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:14 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a" returned: 0 in 0.631s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:14 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info Jul 09 09:43:14 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:15 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:15 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info is being set with open permissions: ugo+rw Jul 09 09:43:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:15 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info Jul 09 09:43:15 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:15 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.info" returned: 0 in 0.635s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-7be38694-2aa5-4788-8f8e-768442ae6e07 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-f110c289-f0fb-4885-8509-2355e368a20a-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-f110c289-f0fb-4885-8509-2355e368a20a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-f110c289-f0fb-4885-8509-2355e368a20a" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-f110c289-f0fb-4885-8509-2355e368a20a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot f110c289-f0fb-4885-8509-2355e368a20a of volume af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77490d0-5d3b-461d-b321-6738720b393a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:16 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a Jul 09 09:43:16 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:17 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a" returned: 0 in 0.733s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af720623-63d0-41fa-85c6-db60c3fe6804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:43:17 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c88c1-3eaa-4f58-890d-65c775d46798]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:17 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 Jul 09 09:43:17 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:18 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:18 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a Jul 09 09:43:18 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:19 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a" returned: 0 in 0.701s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:19 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a Jul 09 09:43:19 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:19 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804.f110c289-f0fb-4885-8509-2355e368a20a" returned: 0 in 0.628s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-f110c289-f0fb-4885-8509-2355e368a20a" released by "_delete_snapshot" :: held 2.899s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" released by "delete_snapshot" :: held 2.921s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Created reservations ['9affbcfc-21a9-4119-bfb9-5d58beebb74f', '30cfa8b6-f772-4547-9683-1ea952836366', '183e6468-06b3-4d82-a604-dcdcd450e5f7', '775d9815-1a2f-417c-9b97-aced1ca81fcf'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:19 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-487adf8c-67a2-4f16-b26a-73ffb1583357 tempest-ProjectMemberTests-92145194 None] Lock "cinder-f110c289-f0fb-4885-8509-2355e368a20a-delete_snapshot" released by "delete_snapshot" :: held 3.048s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-af720623-63d0-41fa-85c6-db60c3fe6804-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "cinder-af720623-63d0-41fa-85c6-db60c3fe6804-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:19 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:20 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[6673f6a4-ecf0-4117-8175-5025195eb148]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:20 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 Jul 09 09:43:20 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:20 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:20 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804 Jul 09 09:43:20 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:21 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-af720623-63d0-41fa-85c6-db60c3fe6804" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-af720623-63d0-41fa-85c6-db60c3fe6804" released by "delete_volume" :: held 1.431s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Created reservations ['3398715a-3ccb-440a-80d0-67a3652400d0', 'c7856c9f-f520-4e12-81d6-ae559b066c0d', '7d47a430-bbf8-4ed1-8ae1-17c24769db7b', 'f4cbf77c-b189-40fb-9572-71699312a372'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:21 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:43:21 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:22 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.635s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:43:22 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-da8edecf-bc3b-4ff2-91cc-da26f7204bea tempest-ProjectMemberTests-92145194 None] Lock "cinder-af720623-63d0-41fa-85c6-db60c3fe6804-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (b43915e6-ff21-4643-982f-2c5619ef2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc5393d-8f29-48f7-abd3-6a370ea11342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc5393d-8f29-48f7-abd3-6a370ea11342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142302089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d5b6ef-fb39-4b8e-847d-de755e7c6016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:23Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b29683-e664-4261-b170-7c5a646fbe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b29683-e664-4261-b170-7c5a646fbe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a31e5e3-d010-4b36-a336-1a8374fcb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a31e5e3-d010-4b36-a336-1a8374fcb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d5b6ef-fb39-4b8e-847d-de755e7c6016', 'volume_name': 'volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e0f114-c8c4-418a-9dfa-04b54d06d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e0f114-c8c4-418a-9dfa-04b54d06d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdca2b6-570b-4a81-9bcf-be856ef8088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:22 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Volume e9d5b6ef-fb39-4b8e-847d-de755e7c6016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016', 'volume_size': 1} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142302089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d5b6ef-fb39-4b8e-847d-de755e7c6016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:23Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Creating volume e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:43:22 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:43:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:22 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 1073741824 Jul 09 09:43:22 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:23 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 1073741824" returned: 0 in 0.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:23 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 Jul 09 09:43:23 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:24 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" returned: 0 in 0.641s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdca2b6-570b-4a81-9bcf-be856ef8088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e99e67-3e95-44d4-842a-d5f3b6aa5f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:24 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Volume volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 (e9d5b6ef-fb39-4b8e-847d-de755e7c6016): created successfully Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e99e67-3e95-44d4-842a-d5f3b6aa5f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (b43915e6-ff21-4643-982f-2c5619ef2502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:24 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-47a3c9f4-7341-4baa-83c5-9d91780cf8d0 tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot 68b01612-e674-42f9-84e9-975bffcff399 of volume e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb1600-e767-4855-b94f-f601dc5e0cb8]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:24 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 Jul 09 09:43:24 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:25 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" returned: 0 in 0.732s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:25 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 1G Jul 09 09:43:25 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:26 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 1G" returned: 0 in 0.795s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:26 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 Jul 09 09:43:26 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:27 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399" returned: 0 in 0.669s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:27 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 is being set with open permissions: ugo+rw Jul 09 09:43:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:27 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 Jul 09 09:43:27 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:27 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:27 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info Jul 09 09:43:27 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:28 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info" returned: 0 in 0.639s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:28 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info is being set with open permissions: ugo+rw Jul 09 09:43:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:28 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info Jul 09 09:43:28 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:28 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.info" returned: 0 in 0.628s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:28 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-b66b29b1-ae50-4846-99f2-a3b4bedad871 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:43:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-68b01612-e674-42f9-84e9-975bffcff399-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-68b01612-e674-42f9-84e9-975bffcff399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-68b01612-e674-42f9-84e9-975bffcff399" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-68b01612-e674-42f9-84e9-975bffcff399" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot 68b01612-e674-42f9-84e9-975bffcff399 of volume e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a205c-40de-40a2-ae95-956a7cb60a5c]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:30 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 Jul 09 09:43:30 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:30 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0daa67-6e19-4e5f-82a5-14cde961766b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:30 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 Jul 09 09:43:30 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:31 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" returned: 0 in 0.728s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:31 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 Jul 09 09:43:31 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:32 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:32 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399 Jul 09 09:43:32 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:32 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016.68b01612-e674-42f9-84e9-975bffcff399" returned: 0 in 0.622s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-68b01612-e674-42f9-84e9-975bffcff399" released by "_delete_snapshot" :: held 2.885s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" released by "delete_snapshot" :: held 2.907s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:32 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Created reservations ['342a7df2-ecf7-4c06-b78b-1392f3cfe62b', '2332a1d5-6374-43d4-b54d-b5249dcf4109', '25b059f5-464e-4c37-83c4-f84d0fd54ea1', 'ba9d0a7f-10f3-49f9-ac04-66f132b4b505'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:33 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f3aa5a3f-36fa-48c6-a3c4-838addf387c8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-68b01612-e674-42f9-84e9-975bffcff399-delete_snapshot" released by "delete_snapshot" :: held 3.034s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-e9d5b6ef-fb39-4b8e-847d-de755e7c6016-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-e9d5b6ef-fb39-4b8e-847d-de755e7c6016-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" acquired by "delete_volume" :: waited 0.026s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e533fbc-187b-48ec-8e4e-b13e98989b0a]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:33 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 Jul 09 09:43:33 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:34 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" returned: 0 in 0.787s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:34 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016 Jul 09 09:43:34 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:34 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" returned: 0 in 0.644s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-e9d5b6ef-fb39-4b8e-847d-de755e7c6016" released by "delete_volume" :: held 1.491s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Created reservations ['ee2279af-1a87-4857-98d8-023199893596', 'ab23dec3-4446-4440-b8a1-bc7923d663d0', '7b0ea6aa-9640-4c29-b62d-5f9fdd4ed6e0', '4ea5212f-df0b-4fe2-b1ab-fe467dcba0ea'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:34 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:43:34 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:35 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.664s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:43:35 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-959f44b3-6709-4fe2-b691-65c05fdfb7e8 tempest-ProjectMemberTests-92145194 None] Lock "cinder-e9d5b6ef-fb39-4b8e-847d-de755e7c6016-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (83988fb5-d728-4fc8-ab99-a71c81e3a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81fbaf-aef0-4489-8589-c66347b30c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81fbaf-aef0-4489-8589-c66347b30c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031332752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521e5d73-f96e-4f97-985a-92454619ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:36Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c25814e-97a4-4f5c-882a-2f1bcaaa618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c25814e-97a4-4f5c-882a-2f1bcaaa618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392aceab-de74-42d7-be04-931d3e251fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392aceab-de74-42d7-be04-931d3e251fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521e5d73-f96e-4f97-985a-92454619ff6a', 'volume_name': 'volume-521e5d73-f96e-4f97-985a-92454619ff6a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd43dd2-ed09-4531-8679-8498945add86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd43dd2-ed09-4531-8679-8498945add86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2313ae38-d327-43e0-9ddb-f511d3788a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:35 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Volume 521e5d73-f96e-4f97-985a-92454619ff6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521e5d73-f96e-4f97-985a-92454619ff6a', 'volume_size': 1} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031332752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521e5d73-f96e-4f97-985a-92454619ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:36Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Creating volume 521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:43:35 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:43:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:35 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a 1073741824 Jul 09 09:43:35 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:36 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a 1073741824" returned: 0 in 0.778s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:36 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a Jul 09 09:43:36 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:37 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a" returned: 0 in 0.621s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2313ae38-d327-43e0-9ddb-f511d3788a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521e5d73-f96e-4f97-985a-92454619ff6a', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f3e080-a346-46cc-b288-02ab7ef41a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:37 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Volume volume-521e5d73-f96e-4f97-985a-92454619ff6a (521e5d73-f96e-4f97-985a-92454619ff6a): created successfully Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f3e080-a346-46cc-b288-02ab7ef41a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:37 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (83988fb5-d728-4fc8-ab99-a71c81e3a875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:37 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-008575f3-6044-4522-a027-f7a2fdb7cdae tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Creating offline snapshot a0fd5d9b-b744-4405-a761-c79166926048 of volume 521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc33c3-06fc-4299-80d5-4f28c2971ace]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:38 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a Jul 09 09:43:38 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:38 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a" returned: 0 in 0.757s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:38 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 1G Jul 09 09:43:38 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:39 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 1G" returned: 0 in 0.771s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521e5d73-f96e-4f97-985a-92454619ff6a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:39 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521e5d73-f96e-4f97-985a-92454619ff6a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 Jul 09 09:43:39 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:40 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-521e5d73-f96e-4f97-985a-92454619ff6a -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048" returned: 0 in 0.699s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:40 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 is being set with open permissions: ugo+rw Jul 09 09:43:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:40 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 Jul 09 09:43:40 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:40 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:40 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info Jul 09 09:43:40 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:41 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info" returned: 0 in 0.628s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:41 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info is being set with open permissions: ugo+rw Jul 09 09:43:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:41 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info Jul 09 09:43:41 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:42 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.info" returned: 0 in 0.634s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:42 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=83,cinder:INSERT=27,cinder:UPDATE=119,cinder:DELETE=12 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:43:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ab01d38e-a276-4cc1-93d9-555affa17e1b tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-a0fd5d9b-b744-4405-a761-c79166926048-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-a0fd5d9b-b744-4405-a761-c79166926048-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-a0fd5d9b-b744-4405-a761-c79166926048" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-a0fd5d9b-b744-4405-a761-c79166926048" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot a0fd5d9b-b744-4405-a761-c79166926048 of volume 521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0e03e-b27b-4f5e-a8fd-9a6d7ffd1069]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:43 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 Jul 09 09:43:43 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:44 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048" returned: 0 in 0.732s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-521e5d73-f96e-4f97-985a-92454619ff6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe62f6-995c-4cb6-906f-058d29fe4c20]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:44 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a Jul 09 09:43:44 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:44 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:44 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 Jul 09 09:43:44 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:45 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048" returned: 0 in 0.736s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:45 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048 Jul 09 09:43:45 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:46 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a.a0fd5d9b-b744-4405-a761-c79166926048" returned: 0 in 0.616s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-a0fd5d9b-b744-4405-a761-c79166926048" released by "_delete_snapshot" :: held 2.909s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" released by "delete_snapshot" :: held 2.934s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Created reservations ['08c5d68a-f340-4358-ac06-f4971c002955', '625aed7f-caac-42b5-b65c-01fd82e80856', '92776547-2c34-46a3-bed3-b7268419f9b4', 'aeda25a1-018a-4b4c-b2b6-4337c845ab5f'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:46 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-05e2631b-5153-440c-af2f-6fd58ff2052e tempest-ProjectMemberTests-92145194 None] Lock "cinder-a0fd5d9b-b744-4405-a761-c79166926048-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-521e5d73-f96e-4f97-985a-92454619ff6a-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "cinder-521e5d73-f96e-4f97-985a-92454619ff6a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" acquired by "delete_volume" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4335f333-8626-4d27-8b43-be0b3ee6f826]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:46 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a Jul 09 09:43:46 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:47 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:47 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a Jul 09 09:43:47 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:47 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-521e5d73-f96e-4f97-985a-92454619ff6a" returned: 0 in 0.634s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-521e5d73-f96e-4f97-985a-92454619ff6a" released by "delete_volume" :: held 1.420s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Created reservations ['e5c899b9-7f30-404f-aba1-c263b76bb528', '62b92dec-1e70-4fa9-a1a3-d24943def0c4', 'f51987b2-964f-41a5-8071-82ba7ef7edb7', '00c2a1fa-fd0b-40dd-9e54-6e737c458da3'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:48 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:43:48 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:48 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.644s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:43:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:43:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-5c2f8d5f-fc27-4b5d-8994-f11e8bcf75a7 tempest-ProjectMemberTests-92145194 None] Lock "cinder-521e5d73-f96e-4f97-985a-92454619ff6a-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (c149c761-4bfe-4b64-98a5-8a825b7325f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035f2171-f1db-45d5-ab7e-f36bcc7d0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035f2171-f1db-45d5-ab7e-f36bcc7d0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946660629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278eecab-15d2-4780-9588-1fefcfcb642f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:49Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb3f872-aaf3-4894-b223-44ac8d4da44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb3f872-aaf3-4894-b223-44ac8d4da44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac25645-79bf-4a9f-93da-c3df6ca054be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac25645-79bf-4a9f-93da-c3df6ca054be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278eecab-15d2-4780-9588-1fefcfcb642f', 'volume_name': 'volume-278eecab-15d2-4780-9588-1fefcfcb642f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd997fa-cbb1-4822-b669-23542c12b6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd997fa-cbb1-4822-b669-23542c12b6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c07f7d-c894-4303-8bac-3623e8cfd829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:49 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Volume 278eecab-15d2-4780-9588-1fefcfcb642f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278eecab-15d2-4780-9588-1fefcfcb642f', 'volume_size': 1} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946660629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278eecab-15d2-4780-9588-1fefcfcb642f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a8094c832b49099be0a2369cdcc7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:43:49Z,use_quota=True,user_id='7f268eb2c32f4d1a8d946316e41222a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Creating volume 278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:43:49 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:49 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f 1073741824 Jul 09 09:43:49 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:49 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f 1073741824" returned: 0 in 0.772s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:50 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f Jul 09 09:43:50 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:50 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:43:50 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:50 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f" returned: 0 in 0.617s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c07f7d-c894-4303-8bac-3623e8cfd829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278eecab-15d2-4780-9588-1fefcfcb642f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df061b66-4bac-41ce-9654-3be5d48841ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=76,cinder:INSERT=31,cinder:UPDATE=100,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:43:50 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Volume volume-278eecab-15d2-4780-9588-1fefcfcb642f (278eecab-15d2-4780-9588-1fefcfcb642f): created successfully Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df061b66-4bac-41ce-9654-3be5d48841ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:43:50 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Flow 'volume_create_manager' (c149c761-4bfe-4b64-98a5-8a825b7325f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:43:50 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-1a9078ef-7b94-4ac2-9409-6dc68d4f773f tempest-ProjectMemberTests-92145194 None] Created volume successfully. Jul 09 09:43:51 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.643s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Creating offline snapshot 6cf55b04-4a01-40aa-a6ad-d886fcab74d9 of volume 278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9aacfb-3a52-425b-b6d7-9331b53631e1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:51 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f Jul 09 09:43:51 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:52 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f" returned: 0 in 0.741s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:52 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 1G Jul 09 09:43:52 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:52 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 1G" returned: 0 in 0.776s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278eecab-15d2-4780-9588-1fefcfcb642f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:52 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278eecab-15d2-4780-9588-1fefcfcb642f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 Jul 09 09:43:52 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:53 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278eecab-15d2-4780-9588-1fefcfcb642f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9" returned: 0 in 0.679s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:53 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 is being set with open permissions: ugo+rw Jul 09 09:43:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:53 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 Jul 09 09:43:53 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:54 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9" returned: 0 in 0.622s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:54 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info Jul 09 09:43:54 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:54 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info" returned: 0 in 0.635s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:54 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info is being set with open permissions: ugo+rw Jul 09 09:43:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:54 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info Jul 09 09:43:54 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:55 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.info" returned: 0 in 0.626s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:43:55 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-137c817f-3b40-48bb-ac8b-e73872371ab2 tempest-ProjectMemberTests-92145194 None] Create snapshot completed successfully Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-6cf55b04-4a01-40aa-a6ad-d886fcab74d9-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-6cf55b04-4a01-40aa-a6ad-d886fcab74d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-6cf55b04-4a01-40aa-a6ad-d886fcab74d9" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-6cf55b04-4a01-40aa-a6ad-d886fcab74d9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Deleting offline snapshot 6cf55b04-4a01-40aa-a6ad-d886fcab74d9 of volume 278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] snapshot_file for this snap is: volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d97a3-be05-483a-8798-d6194859bb23]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:56 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 Jul 09 09:43:56 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:57 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-278eecab-15d2-4780-9588-1fefcfcb642f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:43:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[12073898-db36-451f-956d-f0cd7bcf0b05]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:57 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f Jul 09 09:43:57 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:58 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f" returned: 0 in 0.736s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:58 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 Jul 09 09:43:58 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:58 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9" returned: 0 in 0.729s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:43:59 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9 Jul 09 09:43:59 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:43:59 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f.6cf55b04-4a01-40aa-a6ad-d886fcab74d9" returned: 0 in 0.629s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-6cf55b04-4a01-40aa-a6ad-d886fcab74d9" released by "_delete_snapshot" :: held 2.921s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" released by "delete_snapshot" :: held 2.940s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Created reservations ['c423f1ba-fdc7-47ab-8a25-7d2ac5d12421', 'aaff38aa-6cef-40c4-b071-901f0968cfa9', 'd8106c87-ecf9-4deb-9f7a-38152e42c27b', 'e492cf83-a21a-4ee2-959f-5ccd9a2e9310'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:43:59 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Delete snapshot completed successfully. Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-2ccb8e96-0e77-45a1-885b-299f75859c1f tempest-ProjectMemberTests-92145194 None] Lock "cinder-6cf55b04-4a01-40aa-a6ad-d886fcab74d9-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-278eecab-15d2-4780-9588-1fefcfcb642f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "cinder-278eecab-15d2-4780-9588-1fefcfcb642f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Acquiring lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" acquired by "delete_volume" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebcf72d-6330-4d48-abaf-88194659b20b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:43:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:00 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f Jul 09 09:44:00 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:00 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:00 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f Jul 09 09:44:00 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:01 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-278eecab-15d2-4780-9588-1fefcfcb642f" returned: 0 in 0.636s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "cinder-quobyte-278eecab-15d2-4780-9588-1fefcfcb642f" released by "delete_volume" :: held 1.439s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Created reservations ['9f767550-cf38-4755-b716-b61e80dd0018', '05df24b8-fe18-4fc7-b81a-a2a4aa87202f', 'cdf74de8-709c-453b-ad3f-ad54f71b59b9', 'd48be2f3-672c-4ad7-b3c1-5114ee3dece1'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:01 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:44:01 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:02 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.637s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:02 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:44:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Deleted volume successfully. Jul 09 09:44:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-754e64f9-838f-4de0-a096-b5328b892bc6 tempest-ProjectMemberTests-92145194 None] Lock "cinder-278eecab-15d2-4780-9588-1fefcfcb642f-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (3df28ce7-ef8f-4b22-95fa-8d5a3030f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96599ad-9fd6-4e9c-aed6-054581a76584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96599ad-9fd6-4e9c-aed6-054581a76584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-63492403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839ebebf-7955-4c7e-b93f-b16d50778a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:05Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591775dd-88e0-4103-a326-7f357415e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591775dd-88e0-4103-a326-7f357415e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0573b57-e7ca-47cf-a093-ffa21d3b1a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0573b57-e7ca-47cf-a093-ffa21d3b1a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839ebebf-7955-4c7e-b93f-b16d50778a17', 'volume_name': 'volume-839ebebf-7955-4c7e-b93f-b16d50778a17', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feea5464-7365-4125-854b-177c055dcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feea5464-7365-4125-854b-177c055dcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527f4903-31ac-4567-ae6a-c0c556b0afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:05 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Volume 839ebebf-7955-4c7e-b93f-b16d50778a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839ebebf-7955-4c7e-b93f-b16d50778a17', 'volume_size': 1} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-63492403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839ebebf-7955-4c7e-b93f-b16d50778a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:05Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Creating volume 839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:44:05 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:44:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:05 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 1073741824 Jul 09 09:44:05 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:06 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 1073741824" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:06 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 Jul 09 09:44:06 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:06 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17" returned: 0 in 0.646s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:06 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:44:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527f4903-31ac-4567-ae6a-c0c556b0afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839ebebf-7955-4c7e-b93f-b16d50778a17', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04fde4-f0c6-47b9-b087-2ff8d5c91de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:07 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Volume volume-839ebebf-7955-4c7e-b93f-b16d50778a17 (839ebebf-7955-4c7e-b93f-b16d50778a17): created successfully Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04fde4-f0c6-47b9-b087-2ff8d5c91de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (3df28ce7-ef8f-4b22-95fa-8d5a3030f497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:07 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-778bbb85-cf74-4b04-b5a7-b45bf0623a19 tempest-ProjectReaderTests-331228887 None] Created volume successfully. Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Creating offline snapshot 87312258-71d1-49bb-b35d-23774daa0c6d of volume 839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43bbb6-6a5c-48e7-a982-ff86c7a09b96]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:07 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 Jul 09 09:44:07 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:08 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17" returned: 0 in 0.754s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:08 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d 1G Jul 09 09:44:08 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:09 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d 1G" returned: 0 in 0.764s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839ebebf-7955-4c7e-b93f-b16d50778a17 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:09 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839ebebf-7955-4c7e-b93f-b16d50778a17 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d Jul 09 09:44:09 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:09 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839ebebf-7955-4c7e-b93f-b16d50778a17 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d" returned: 0 in 0.681s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:09 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d is being set with open permissions: ugo+rw Jul 09 09:44:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:09 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d Jul 09 09:44:09 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:10 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:10 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info Jul 09 09:44:10 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:11 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info" returned: 0 in 0.624s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:11 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info is being set with open permissions: ugo+rw Jul 09 09:44:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:11 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info Jul 09 09:44:11 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:11 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.info" returned: 0 in 0.619s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.170s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:11 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-344dc0c1-a9c3-4ff3-b329-17f466c019ff tempest-ProjectReaderTests-331228887 None] Create snapshot completed successfully Jul 09 09:44:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-87312258-71d1-49bb-b35d-23774daa0c6d-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-87312258-71d1-49bb-b35d-23774daa0c6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-87312258-71d1-49bb-b35d-23774daa0c6d" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-87312258-71d1-49bb-b35d-23774daa0c6d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Deleting offline snapshot 87312258-71d1-49bb-b35d-23774daa0c6d of volume 839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] snapshot_file for this snap is: volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[369590b0-7134-47b8-9911-18552b0e8c67]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:13 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d Jul 09 09:44:13 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:13 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d" returned: 0 in 0.736s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-839ebebf-7955-4c7e-b93f-b16d50778a17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5016e4-9715-455a-8edc-48badfa454b4]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:13 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 Jul 09 09:44:13 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:14 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17" returned: 0 in 0.723s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:14 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d Jul 09 09:44:14 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:15 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d" returned: 0 in 0.709s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:15 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d Jul 09 09:44:15 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:15 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17.87312258-71d1-49bb-b35d-23774daa0c6d" returned: 0 in 0.615s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-87312258-71d1-49bb-b35d-23774daa0c6d" released by "_delete_snapshot" :: held 2.868s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" released by "delete_snapshot" :: held 2.887s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Created reservations ['f1fce810-b75a-4c2b-a165-eb8f94d823cf', '5a7257fa-0dff-4e02-b5ae-4b01b7b7f192', '3c9735a7-160e-4767-9f0e-35610de30621', '5f7426de-3535-4170-b623-8918527faaf9'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Delete snapshot completed successfully. Jul 09 09:44:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-0695d1be-b33e-42f7-a6de-1a606b66a3ed tempest-ProjectReaderTests-331228887 None] Lock "cinder-87312258-71d1-49bb-b35d-23774daa0c6d-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-839ebebf-7955-4c7e-b93f-b16d50778a17-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-839ebebf-7955-4c7e-b93f-b16d50778a17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[61976ad5-78f4-4403-aa91-d7da719af9f5]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:16 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 Jul 09 09:44:16 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:16 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:16 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:17 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17 Jul 09 09:44:17 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:17 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-839ebebf-7955-4c7e-b93f-b16d50778a17" returned: 0 in 0.656s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-839ebebf-7955-4c7e-b93f-b16d50778a17" released by "delete_volume" :: held 1.463s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Created reservations ['d3c1789d-8337-4a65-ad76-210757e5983b', '4b62b1aa-c84c-4662-9e50-cf123133c997', '5da055b9-728c-4ef9-8f1e-668bf2f3c5c2', 'd6a412e5-547a-4133-ad90-02587439aded'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:17 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:17 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:44:17 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:18 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.628s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:44:18 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Deleted volume successfully. Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-cfc6a52a-1742-4cc0-a527-e66d8f8bdbb8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-839ebebf-7955-4c7e-b93f-b16d50778a17-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (d6568aa9-7543-4624-857a-f43ef086c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34b41d9-1e6c-449c-98d5-5e179ba1c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34b41d9-1e6c-449c-98d5-5e179ba1c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144973826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eeba260-453f-4a14-8482-96412998443d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:19Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c84518-a44b-4ee0-a077-d8b6de0ee8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c84518-a44b-4ee0-a077-d8b6de0ee8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6743a2a-4e78-4604-ae13-2012d147fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6743a2a-4e78-4604-ae13-2012d147fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eeba260-453f-4a14-8482-96412998443d', 'volume_name': 'volume-7eeba260-453f-4a14-8482-96412998443d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce95a6c-45c5-4ce9-abc6-1f57f256b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce95a6c-45c5-4ce9-abc6-1f57f256b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db069f0e-be35-448f-83a3-fc36cca7a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:18 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Volume 7eeba260-453f-4a14-8482-96412998443d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eeba260-453f-4a14-8482-96412998443d', 'volume_size': 1} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144973826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eeba260-453f-4a14-8482-96412998443d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:19Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Creating volume 7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:44:18 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:44:18 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:18 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d 1073741824 Jul 09 09:44:18 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:19 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d 1073741824" returned: 0 in 0.790s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:19 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:19 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d Jul 09 09:44:19 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:20 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d" returned: 0 in 0.638s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db069f0e-be35-448f-83a3-fc36cca7a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eeba260-453f-4a14-8482-96412998443d', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99532377-8cb7-4b6f-8c0a-75282ca41562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:20 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Volume volume-7eeba260-453f-4a14-8482-96412998443d (7eeba260-453f-4a14-8482-96412998443d): created successfully Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99532377-8cb7-4b6f-8c0a-75282ca41562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (d6568aa9-7543-4624-857a-f43ef086c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:20 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a940cdc2-34f5-48e4-8725-d5d1ad12da3a tempest-ProjectReaderTests-331228887 None] Created volume successfully. Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:20 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Creating offline snapshot fb4af5b7-e9c7-4580-af29-9eb3c7689c78 of volume 7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:44:21 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb76635-4d3c-499c-a1d6-705edc6b8dad]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:21 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d Jul 09 09:44:21 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:21 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d" returned: 0 in 0.741s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:21 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:21 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 1G Jul 09 09:44:21 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:22 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 1G" returned: 0 in 0.769s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:22 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eeba260-453f-4a14-8482-96412998443d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:22 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eeba260-453f-4a14-8482-96412998443d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 Jul 09 09:44:22 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:23 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eeba260-453f-4a14-8482-96412998443d -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78" returned: 0 in 0.673s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:23 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 is being set with open permissions: ugo+rw Jul 09 09:44:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:23 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 Jul 09 09:44:23 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:23 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:23 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:23 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info Jul 09 09:44:23 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:24 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info" returned: 0 in 0.648s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:24 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info is being set with open permissions: ugo+rw Jul 09 09:44:24 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:24 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info Jul 09 09:44:24 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:25 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.info" returned: 0 in 0.637s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:25 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:25 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-55475965-db07-4343-8fc0-cfab02ee0ccf tempest-ProjectReaderTests-331228887 None] Create snapshot completed successfully Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-fb4af5b7-e9c7-4580-af29-9eb3c7689c78-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-fb4af5b7-e9c7-4580-af29-9eb3c7689c78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-fb4af5b7-e9c7-4580-af29-9eb3c7689c78" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-fb4af5b7-e9c7-4580-af29-9eb3c7689c78" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Deleting offline snapshot fb4af5b7-e9c7-4580-af29-9eb3c7689c78 of volume 7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] snapshot_file for this snap is: volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[51502524-c1dd-44df-84b5-c387921a341b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:26 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:26 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 Jul 09 09:44:26 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:27 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78" returned: 0 in 0.774s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eeba260-453f-4a14-8482-96412998443d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[1801ab42-c0b7-4f56-9957-d73c43eea1ab]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:27 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d Jul 09 09:44:27 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:27 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d" returned: 0 in 0.757s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:27 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:27 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 Jul 09 09:44:27 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:28 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78" returned: 0 in 0.710s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:28 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:28 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78 Jul 09 09:44:28 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:29 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:29 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d.fb4af5b7-e9c7-4580-af29-9eb3c7689c78" returned: 0 in 0.647s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-fb4af5b7-e9c7-4580-af29-9eb3c7689c78" released by "_delete_snapshot" :: held 2.980s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" released by "delete_snapshot" :: held 3.002s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:29 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Created reservations ['91790d2f-cb77-4976-9666-9b0f0c83461c', '126bfb22-59fa-4f48-b4a5-05ebbeb5b64f', 'fa796efc-f599-4d9e-ad4d-f1b9b3966341', 'efa3be2c-9b23-49e5-a6ef-60d8dece837a'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:29 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Delete snapshot completed successfully. Jul 09 09:44:29 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-8aecea01-59ea-40cd-aea2-6327f01d95bf tempest-ProjectReaderTests-331228887 None] Lock "cinder-fb4af5b7-e9c7-4580-af29-9eb3c7689c78-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-7eeba260-453f-4a14-8482-96412998443d-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "cinder-7eeba260-453f-4a14-8482-96412998443d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d262f6a9-1c5b-4ad9-9c8f-5c1d9359b412]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:30 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:30 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d Jul 09 09:44:30 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:31 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d" returned: 0 in 0.761s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:31 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d Jul 09 09:44:31 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:31 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:31 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-7eeba260-453f-4a14-8482-96412998443d" returned: 0 in 0.640s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:31 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-7eeba260-453f-4a14-8482-96412998443d" released by "delete_volume" :: held 1.457s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:31 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Created reservations ['774a40d3-d46c-4711-9006-a35b9a2bdd64', '5a92e77f-2332-4f41-be8c-057dfa0594b8', 'ab4fe2e0-472c-44e1-a567-c198e417a8e5', '1b9ccab9-cea0-4cf8-a6e4-d8a48d8b53e5'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:32 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:44:32 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:32 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.631s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:44:32 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Deleted volume successfully. Jul 09 09:44:32 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-3820f6a7-d8b0-4450-abda-d42bb89d0d8d tempest-ProjectReaderTests-331228887 None] Lock "cinder-7eeba260-453f-4a14-8482-96412998443d-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (18676f83-05b8-43fe-907d-af39c69455df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce1461b-256b-48f1-98da-478286d69fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce1461b-256b-48f1-98da-478286d69fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403656109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:33Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b719774-4ac4-44d3-a7b9-5c4188e81849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b719774-4ac4-44d3-a7b9-5c4188e81849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2bebf1-df2b-43d5-855b-52da2b9a2965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2bebf1-df2b-43d5-855b-52da2b9a2965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af', 'volume_name': 'volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cd9f1f-7ce0-4422-9fa6-7b527386c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cd9f1f-7ce0-4422-9fa6-7b527386c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc88bab-2c56-499a-849c-6551dcc8f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:33 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Volume 9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af', 'volume_size': 1} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403656109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:33Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Creating volume 9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:44:33 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:33 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af 1073741824 Jul 09 09:44:33 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:33 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:33 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af 1073741824" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:34 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af Jul 09 09:44:34 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:34 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" returned: 0 in 0.693s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc88bab-2c56-499a-849c-6551dcc8f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca81b2d-86fd-4b0f-b016-917a8bf894c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:34 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Volume volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af (9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af): created successfully Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca81b2d-86fd-4b0f-b016-917a8bf894c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:34 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (18676f83-05b8-43fe-907d-af39c69455df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:34 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-15618fa9-c032-4950-ae96-74d9ec540fb7 tempest-ProjectReaderTests-331228887 None] Created volume successfully. Jul 09 09:44:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:35 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Creating offline snapshot 861d4adb-e86c-4dcf-a263-4ff76c7aa636 of volume 9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:44:35 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94ca9a-0130-4b37-9f79-44ede21bd42e]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:35 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:35 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af Jul 09 09:44:35 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:36 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" returned: 0 in 0.746s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:36 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 1G Jul 09 09:44:36 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:36 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 1G" returned: 0 in 0.792s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:36 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:36 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 Jul 09 09:44:36 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:37 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636" returned: 0 in 0.705s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:37 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 is being set with open permissions: ugo+rw Jul 09 09:44:37 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:37 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 Jul 09 09:44:37 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:38 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636" returned: 0 in 0.624s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:38 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info Jul 09 09:44:38 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:38 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info" returned: 0 in 0.631s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:38 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info is being set with open permissions: ugo+rw Jul 09 09:44:38 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:38 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info Jul 09 09:44:38 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:39 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.info" returned: 0 in 0.646s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:39 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:39 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-a009e3e0-33b3-454e-b4e7-4673f5276498 tempest-ProjectReaderTests-331228887 None] Create snapshot completed successfully Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-861d4adb-e86c-4dcf-a263-4ff76c7aa636-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-861d4adb-e86c-4dcf-a263-4ff76c7aa636-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-861d4adb-e86c-4dcf-a263-4ff76c7aa636" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-861d4adb-e86c-4dcf-a263-4ff76c7aa636" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Deleting offline snapshot 861d4adb-e86c-4dcf-a263-4ff76c7aa636 of volume 9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] snapshot_file for this snap is: volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b4be6-1642-4aa4-a939-11a14c6bbc3d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:40 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 Jul 09 09:44:40 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:41 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:41 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:44:41 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d53614-d965-4a86-9c09-bd66f745d027]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:41 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af Jul 09 09:44:41 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:42 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" returned: 0 in 0.754s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:42 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 Jul 09 09:44:42 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:42 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636" returned: 0 in 0.724s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:42 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636 Jul 09 09:44:42 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:43 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af.861d4adb-e86c-4dcf-a263-4ff76c7aa636" returned: 0 in 0.643s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-861d4adb-e86c-4dcf-a263-4ff76c7aa636" released by "_delete_snapshot" :: held 2.968s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" released by "delete_snapshot" :: held 2.989s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=55,cinder:INSERT=22,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Created reservations ['237fcdd6-cbde-4183-a268-2e2e37ddc0a8', 'ece82407-12bb-442a-a4e0-05129dd69687', '8eb3bd2b-3f3e-4ed4-bd8e-cd95d3425495', '9df2c12a-167f-41b2-a85f-63557af55e4b'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:43 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Delete snapshot completed successfully. Jul 09 09:44:43 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-6c0ab062-c1dc-42bc-9ff3-141cf8151129 tempest-ProjectReaderTests-331228887 None] Lock "cinder-861d4adb-e86c-4dcf-a263-4ff76c7aa636-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "cinder-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12ffc4-84f8-4ff1-a6ea-a52a61ef1210]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:44 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af Jul 09 09:44:44 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:45 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" returned: 0 in 0.753s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:45 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af Jul 09 09:44:45 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:46 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" returned: 0 in 0.645s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af" released by "delete_volume" :: held 1.454s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Created reservations ['c74ca018-a707-46c7-b236-5ad484467421', '9f6d5285-b71b-4909-9aa4-793b60e59653', 'af93087b-b303-4ee9-9797-5df7e2941a7e', '4ffc0095-99ab-46d7-b4fb-992a820a9c66'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:46 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:44:46 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:46 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.637s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:46 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:44:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Deleted volume successfully. Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c88382-e012-47dc-ab2d-eaf6c798533d tempest-ProjectReaderTests-331228887 None] Lock "cinder-9fc1ca47-a496-4fd5-b84c-7d0f65a9c6af-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (5faea656-3910-4373-8e17-0f85e4cced84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af2934-2d71-437c-847c-94f09b1413e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7af2934-2d71-437c-847c-94f09b1413e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67691314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ff86b3-4250-45f6-987a-053b758de63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:47Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537d54cd-a397-4ee6-89cd-d30bbdac154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537d54cd-a397-4ee6-89cd-d30bbdac154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aee8a4-c114-4d0d-9846-2c6cca8fdf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aee8a4-c114-4d0d-9846-2c6cca8fdf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ff86b3-4250-45f6-987a-053b758de63f', 'volume_name': 'volume-60ff86b3-4250-45f6-987a-053b758de63f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a48b77a-c070-4e80-b563-a73648e02dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a48b77a-c070-4e80-b563-a73648e02dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92e6d6a-28a4-4f36-9d4b-7ccae56c8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:47 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Volume 60ff86b3-4250-45f6-987a-053b758de63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ff86b3-4250-45f6-987a-053b758de63f', 'volume_size': 1} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67691314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ff86b3-4250-45f6-987a-053b758de63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:44:47Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Creating volume 60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:44:47 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:44:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:47 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f 1073741824 Jul 09 09:44:47 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:48 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f 1073741824" returned: 0 in 0.806s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:48 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f Jul 09 09:44:48 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:48 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92e6d6a-28a4-4f36-9d4b-7ccae56c8580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ff86b3-4250-45f6-987a-053b758de63f', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628eb6be-76b8-4104-923f-2c1847b84d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:44:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Volume volume-60ff86b3-4250-45f6-987a-053b758de63f (60ff86b3-4250-45f6-987a-053b758de63f): created successfully Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628eb6be-76b8-4104-923f-2c1847b84d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:44:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (5faea656-3910-4373-8e17-0f85e4cced84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:44:48 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-3ac1b6dc-5703-4c4b-9f07-0ecee90aef17 tempest-ProjectReaderTests-331228887 None] Created volume successfully. Jul 09 09:44:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Creating offline snapshot fc8a6aa7-ef87-4460-b596-4d4add15dddf of volume 60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:44:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca8f3e-35ec-4006-9a4d-578bd1334ebd]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:49 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f Jul 09 09:44:49 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:50 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f" returned: 0 in 0.737s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:50 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf 1G Jul 09 09:44:50 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:50 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:44:50 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:51 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf 1G" returned: 0 in 0.783s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ff86b3-4250-45f6-987a-053b758de63f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:51 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ff86b3-4250-45f6-987a-053b758de63f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf Jul 09 09:44:51 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:51 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.621s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:44:51 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ff86b3-4250-45f6-987a-053b758de63f -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf" returned: 0 in 0.665s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:51 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf is being set with open permissions: ugo+rw Jul 09 09:44:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:51 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf Jul 09 09:44:51 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:52 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf" returned: 0 in 0.612s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:52 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=61,cinder:INSERT=18,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:44:52 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:52 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info Jul 09 09:44:52 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:53 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info" returned: 0 in 0.632s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:53 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info is being set with open permissions: ugo+rw Jul 09 09:44:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:53 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info Jul 09 09:44:53 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:53 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.info" returned: 0 in 0.675s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:53 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.182s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:44:53 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-aa3193ae-a32a-41e4-9919-1396f9f322ac tempest-ProjectReaderTests-331228887 None] Create snapshot completed successfully Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-fc8a6aa7-ef87-4460-b596-4d4add15dddf-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-fc8a6aa7-ef87-4460-b596-4d4add15dddf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-fc8a6aa7-ef87-4460-b596-4d4add15dddf" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-fc8a6aa7-ef87-4460-b596-4d4add15dddf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Deleting offline snapshot fc8a6aa7-ef87-4460-b596-4d4add15dddf of volume 60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] snapshot_file for this snap is: volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d78e0-958d-4072-ad92-56e73410c75f]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:55 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf Jul 09 09:44:55 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:55 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf" returned: 0 in 0.756s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:55 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ff86b3-4250-45f6-987a-053b758de63f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:44:55 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[04646af8-8161-4b7d-b95f-f57ee3502776]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:55 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f Jul 09 09:44:55 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:56 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f" returned: 0 in 0.771s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:56 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf Jul 09 09:44:56 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:57 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf" returned: 0 in 0.721s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:57 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf Jul 09 09:44:57 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:57 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f.fc8a6aa7-ef87-4460-b596-4d4add15dddf" returned: 0 in 0.668s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-fc8a6aa7-ef87-4460-b596-4d4add15dddf" released by "_delete_snapshot" :: held 3.005s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" released by "delete_snapshot" :: held 3.028s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:57 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Created reservations ['ac220a82-3993-4937-810e-02df2af8a614', 'd2e2654b-af03-4d52-88d9-54c5ad79e442', 'c65f4e7f-edf6-46f7-9df0-8a234fd25731', '82e2f0f6-74bb-43a6-9621-425ecd1a2e33'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:44:57 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Delete snapshot completed successfully. Jul 09 09:44:58 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-f7d00b75-74e3-44bd-bd65-600c6437989c tempest-ProjectReaderTests-331228887 None] Lock "cinder-fc8a6aa7-ef87-4460-b596-4d4add15dddf-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-60ff86b3-4250-45f6-987a-053b758de63f-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "cinder-60ff86b3-4250-45f6-987a-053b758de63f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" acquired by "delete_volume" :: waited 0.017s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccae54a-fb9f-4e04-82e4-7bb53933aa88]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:59 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f Jul 09 09:44:59 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:44:59 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f" returned: 0 in 0.754s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:44:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:44:59 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f Jul 09 09:44:59 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:00 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-60ff86b3-4250-45f6-987a-053b758de63f" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-60ff86b3-4250-45f6-987a-053b758de63f" released by "delete_volume" :: held 1.465s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Created reservations ['93471345-f6d5-4b0e-a0f7-964416c41815', '17edae7d-b253-48a1-9756-6376863c9dd8', 'c655ec64-cb5e-4b52-8549-351f483deef7', '33cd025d-45c8-4f9e-96dd-b3acea4fa4b7'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:00 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:45:00 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:01 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.648s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:45:01 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Deleted volume successfully. Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-148fc001-488d-4d00-b314-fa40782641c5 tempest-ProjectReaderTests-331228887 None] Lock "cinder-60ff86b3-4250-45f6-987a-053b758de63f-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (ab040d52-57ae-40ff-8ca0-01cc6302dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99ecd9d-47f7-4171-897f-3d3814b222f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99ecd9d-47f7-4171-897f-3d3814b222f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417131918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:45:02Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c346e8-1121-40ee-9c5f-491770e6c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c346e8-1121-40ee-9c5f-491770e6c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f605c45-68fe-46a9-ba17-e3b97324f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f605c45-68fe-46a9-ba17-e3b97324f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb', 'volume_name': 'volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4581a6-3a8e-4d2e-9e48-c6cf487a2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4581a6-3a8e-4d2e-9e48-c6cf487a2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e5eb38-1b6f-4574-b05a-275b5601bfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:01 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Volume c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb', 'volume_size': 1} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417131918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4689891fa72946638164cd270fbb919e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:45:02Z,use_quota=True,user_id='3e920665a7a946868c4c138b3df2001d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Creating volume c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:45:01 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:45:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:01 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb 1073741824 Jul 09 09:45:01 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:02 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb 1073741824" returned: 0 in 0.872s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:02 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb Jul 09 09:45:02 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:03 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" returned: 0 in 0.665s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e5eb38-1b6f-4574-b05a-275b5601bfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d371d1-1525-4594-b609-7e57ba4f3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:03 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Volume volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb (c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb): created successfully Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d371d1-1525-4594-b609-7e57ba4f3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Flow 'volume_create_manager' (ab040d52-57ae-40ff-8ca0-01cc6302dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:03 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d8bd5799-cc1d-4621-b769-f2b7403b930c tempest-ProjectReaderTests-331228887 None] Created volume successfully. Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Creating offline snapshot a41dfb4b-92af-4e31-af79-d8a107b74ff0 of volume c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8b7b2e-6e9f-4379-bd8f-95358b1a2daa]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:04 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb Jul 09 09:45:04 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:04 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" returned: 0 in 0.772s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:04 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 1G Jul 09 09:45:04 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:05 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 1G" returned: 0 in 0.798s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:05 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 Jul 09 09:45:05 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:06 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0" returned: 0 in 0.711s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:06 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 is being set with open permissions: ugo+rw Jul 09 09:45:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:06 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 Jul 09 09:45:06 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:06 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0" returned: 0 in 0.662s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:06 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:06 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info Jul 09 09:45:06 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:07 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info" returned: 0 in 0.685s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:07 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info is being set with open permissions: ugo+rw Jul 09 09:45:07 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:07 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info Jul 09 09:45:07 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:08 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.info" returned: 0 in 0.642s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:08 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.348s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:08 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-ffb27f9a-8da7-4eea-86a1-48fa65d774c2 tempest-ProjectReaderTests-331228887 None] Create snapshot completed successfully Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-a41dfb4b-92af-4e31-af79-d8a107b74ff0-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-a41dfb4b-92af-4e31-af79-d8a107b74ff0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-a41dfb4b-92af-4e31-af79-d8a107b74ff0" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-a41dfb4b-92af-4e31-af79-d8a107b74ff0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Deleting offline snapshot a41dfb4b-92af-4e31-af79-d8a107b74ff0 of volume c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] snapshot_file for this snap is: volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1443eb7-3fb1-4326-a7bc-cedae8269fd1]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:09 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 Jul 09 09:45:09 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:09 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0" returned: 0 in 0.742s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa56e8-d2fe-4fb1-be86-c0c396a030f8]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:09 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:10 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb Jul 09 09:45:10 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:10 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" returned: 0 in 0.749s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:10 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:10 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 Jul 09 09:45:10 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:11 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0" returned: 0 in 0.758s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:11 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:11 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0 Jul 09 09:45:11 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:12 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:12 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb.a41dfb4b-92af-4e31-af79-d8a107b74ff0" returned: 0 in 0.649s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-a41dfb4b-92af-4e31-af79-d8a107b74ff0" released by "_delete_snapshot" :: held 2.984s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" released by "delete_snapshot" :: held 3.007s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:12 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Created reservations ['54373a1f-039f-41f5-bdab-9df60b72f5d7', 'a4f8386e-cb4d-4fe4-b00c-69b56de7bb19', 'e6cdbe30-5cdb-4780-ad77-5d3ec4cb80a4', '93a2f2ee-5de8-435c-b231-b888e773d2c8'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:45:12 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Delete snapshot completed successfully. Jul 09 09:45:12 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-972ce960-e712-45f3-a59c-f1712c6e7ad8 tempest-ProjectReaderTests-331228887 None] Lock "cinder-a41dfb4b-92af-4e31-af79-d8a107b74ff0-delete_snapshot" released by "delete_snapshot" :: held 3.141s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "cinder-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Acquiring lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" acquired by "delete_volume" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a83a1e-0ea3-4813-b097-05961a33aa40]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:13 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:13 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb Jul 09 09:45:13 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:14 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" returned: 0 in 0.750s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:14 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb Jul 09 09:45:14 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:14 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" returned: 0 in 0.634s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "cinder-quobyte-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb" released by "delete_volume" :: held 1.439s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Created reservations ['05251742-35d6-4330-aa66-d3d4c2f5b2ca', 'b995666d-db52-4bbf-af1b-5aeaa6169bae', '8d774219-886a-48a7-a92c-089fbb699292', '1d2a3ca8-7bf5-4016-985e-43216b7851b5'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:14 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:15 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:45:15 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:15 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:15 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.684s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:15 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:45:15 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Deleted volume successfully. Jul 09 09:45:15 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-38d50100-cf8f-460c-b109-9d977c640d5f tempest-ProjectReaderTests-331228887 None] Lock "cinder-c2afab95-bd53-4cd3-b7a9-9eaa42d6d3fb-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:24 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:DELETE=3,cinder:SELECT=21,cinder:INSERT=11,cinder:UPDATE=27 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:45:25 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:INSERT=14,cinder:UPDATE=57,cinder:SELECT=37,cinder:DELETE=3 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Flow 'volume_create_manager' (0a84e3c2-850c-4e7d-a9cd-d38c6d2fd71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ff5532-8781-4fbd-b4c0-c7f183de2f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ff5532-8781-4fbd-b4c0-c7f183de2f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-990288752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03727d7-ebf7-4fb7-b131-2db42f993e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22887aae962a4e2db54d61288766b23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:45:41Z,use_quota=True,user_id='a3722ee6b1ec4c3280dd6e7b549e79cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d1fdeb-20fc-4c05-b4ec-9170d9a30dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d1fdeb-20fc-4c05-b4ec-9170d9a30dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf8c099-4faa-4213-a761-f83e6f627d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf8c099-4faa-4213-a761-f83e6f627d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03727d7-ebf7-4fb7-b131-2db42f993e20', 'volume_name': 'volume-b03727d7-ebf7-4fb7-b131-2db42f993e20', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e7f1a-6906-4254-96be-be5bb2f1891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e7f1a-6906-4254-96be-be5bb2f1891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3071a013-609c-4f49-b7bb-ab524f26745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:40 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Volume b03727d7-ebf7-4fb7-b131-2db42f993e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03727d7-ebf7-4fb7-b131-2db42f993e20', 'volume_size': 1} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-990288752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03727d7-ebf7-4fb7-b131-2db42f993e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22887aae962a4e2db54d61288766b23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:45:41Z,use_quota=True,user_id='a3722ee6b1ec4c3280dd6e7b549e79cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)}" {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Creating volume b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:45:40 devstack cinder-volume[87265]: INFO cinder.volume.drivers.remotefs [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] casted to osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd Jul 09 09:45:40 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 1073741824 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:40 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 1073741824 Jul 09 09:45:40 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:41 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 1073741824" returned: 0 in 0.829s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:41 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:41 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:45:41 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:42 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.658s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'} {{(pid=87265) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3071a013-609c-4f49-b7bb-ab524f26745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03727d7-ebf7-4fb7-b131-2db42f993e20', 'volume_size': 1}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c6b2d0-f880-4d67-b382-cb0868372363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:42 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Volume volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 (b03727d7-ebf7-4fb7-b131-2db42f993e20): created successfully Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c6b2d0-f880-4d67-b382-cb0868372363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:42 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Flow 'volume_create_manager' (0a84e3c2-850c-4e7d-a9cd-d38c6d2fd71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:42 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-19a051cb-e300-4176-992e-f814fa63dcc8 tempest-SnapshotDependencyTests-1981065148 None] Created volume successfully. Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Creating offline snapshot 30ab87ab-6298-4f05-9480-fd02092cb872 of volume b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e801e7e-00b9-4c74-bd8a-8591d50a8791]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:43 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:45:43 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:43 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.777s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:43 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 1G {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:43 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 1G Jul 09 09:45:43 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:44 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 1G" returned: 0 in 0.805s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:44 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:44 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:44 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:45 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 -F qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.712s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:45 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 is being set with open permissions: ugo+rw Jul 09 09:45:45 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:45 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:45 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:46 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.653s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:46 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info Jul 09 09:45:46 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:46 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info" returned: 0 in 0.649s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:46 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info is being set with open permissions: ugo+rw Jul 09 09:45:46 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:46 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info Jul 09 09:45:46 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:47 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.info" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:47 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.307s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:47 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-d02bf8ba-a11f-4852-a32c-6522aaabdacc tempest-SnapshotDependencyTests-1981065148 None] Create snapshot completed successfully Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87265) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Flow 'volume_create_manager' (2b013eb2-de87-4df1-ad5d-88c6e0be50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2b4001-043f-4a6b-9919-645d8b98c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2b4001-043f-4a6b-9919-645d8b98c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e54dfa-9543-4dc0-a868-b81a16c4ced4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22887aae962a4e2db54d61288766b23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30ab87ab-6298-4f05-9480-fd02092cb872,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:45:49Z,use_quota=True,user_id='a3722ee6b1ec4c3280dd6e7b549e79cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(129da828-2ed1-4460-8082-56460dab0ede),volume_type_id=129da828-2ed1-4460-8082-56460dab0ede)' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cafbe5b-f56b-4eba-ab0f-a98800332d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cafbe5b-f56b-4eba-ab0f-a98800332d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18cd97b-1dae-4fe5-a24f-e1283e568272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18cd97b-1dae-4fe5-a24f-e1283e568272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24e54dfa-9543-4dc0-a868-b81a16c4ced4', 'volume_name': 'volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4', 'volume_size': 1, 'snapshot_id': '30ab87ab-6298-4f05-9480-fd02092cb872'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286371a-1fdd-4f94-98d7-02d01514a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286371a-1fdd-4f94-98d7-02d01514a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3ff4c2-e48f-45ea-8585-a175096659da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:48 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Volume 24e54dfa-9543-4dc0-a868-b81a16c4ced4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4', 'volume_size': 1, 'snapshot_id': '30ab87ab-6298-4f05-9480-fd02092cb872'} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872-24e54dfa-9543-4dc0-a868-b81a16c4ced4" by "_create_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872-24e54dfa-9543-4dc0-a868-b81a16c4ced4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Creating volume 24e54dfa-9543-4dc0-a868-b81a16c4ced4 from snapshot 30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Selected osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd as target Quobyte volume. {{(pid=87265) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" by "_copy_volume_from_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:48 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] snapshot: 30ab87ab-6298-4f05-9480-fd02092cb872, volume: 24e54dfa-9543-4dc0-a868-b81a16c4ced4, {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f93e5b-46b5-4b48-95aa-0408de06b547]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:49 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:49 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:49 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.730s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03727d7-ebf7-4fb7-b131-2db42f993e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Creating direct copy from snapshot {{(pid=87265) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d527a126-86ef-433b-bbc2-b7cbfd3d0547]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:49 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:49 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:45:49 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:50 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.741s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG cinder.utils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Path /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 not found in is_blk_device check {{(pid=87265) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:50 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 Jul 09 09:45:50 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:50 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:50 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:45:50 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:51 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:51 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.651s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:51 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:45:51 devstack cinder-volume[87265]: DEBUG oslo_service.periodic_task [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] Running periodic task VolumeManager._thread_info {{(pid=87265) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:45:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread count: 29 {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:45:51 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-03723fb9-bb28-4b60-bc65-967874471239 None None] thread info: [<_MainThread(MainThread, started 127148088778880)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87265) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:45:54 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4" returned: 0 in 4.428s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:54 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9844f00-f529-4080-8fb4-67d8837a972d]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:54 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:55 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:45:55 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:55 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.907s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:55 devstack cinder-volume[87265]: DEBUG cinder.image.image_utils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Image conversion details: src /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 {{(pid=87265) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 09:45:55 devstack cinder-volume[87265]: INFO cinder.image.image_utils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Converted 1024.00 MB image at 231.21 MB/s Jul 09 09:45:55 devstack cinder-volume[87265]: WARNING cinder.volume.drivers.remotefs [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 is being set with open permissions: ugo+rw Jul 09 09:45:55 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:55 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 Jul 09 09:45:55 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:56 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4" returned: 0 in 0.630s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" released by "_copy_volume_from_snapshot" :: held 7.518s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872-24e54dfa-9543-4dc0-a868-b81a16c4ced4" released by "_create_volume_from_snapshot" :: held 7.545s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.560s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3ff4c2-e48f-45ea-8585-a175096659da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4', 'volume_size': 1, 'snapshot_id': '30ab87ab-6298-4f05-9480-fd02092cb872'}' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4041e1-cc20-42d2-a69d-303ddf0673da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:45:56 devstack cinder-volume[87265]: INFO cinder.volume.flows.manager.create_volume [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Volume volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 (24e54dfa-9543-4dc0-a868-b81a16c4ced4): created successfully Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4041e1-cc20-42d2-a69d-303ddf0673da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87265) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:45:56 devstack cinder-volume[87265]: DEBUG cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Flow 'volume_create_manager' (2b013eb2-de87-4df1-ad5d-88c6e0be50c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87265) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:45:56 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-bf42647c-e70d-44d4-9ef1-01b03f6cf0d3 tempest-SnapshotDependencyTests-1981065148 None] Created volume successfully. Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-30ab87ab-6298-4f05-9480-fd02092cb872-delete_snapshot" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-30ab87ab-6298-4f05-9480-fd02092cb872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" by "delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872" by "_delete_snapshot" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Deleting offline snapshot 30ab87ab-6298-4f05-9480-fd02092cb872 of volume b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] snapshot_file for this snap is: volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470bdb7-7519-4b86-822b-d19df489871b]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:57 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:57 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:57 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:58 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.741s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:58 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.remotefs [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03727d7-ebf7-4fb7-b131-2db42f993e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87265) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:45:58 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb272e7-de0c-44ab-90de-9f624944afb0]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:45:58 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:58 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:45:58 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:59 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.738s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:59 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:59 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:45:59 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 09 09:45:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.715s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:45:59 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:45:59 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872 Jul 09 09:45:59 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:00 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20.30ab87ab-6298-4f05-9480-fd02092cb872" returned: 0 in 0.627s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-30ab87ab-6298-4f05-9480-fd02092cb872" released by "_delete_snapshot" :: held 2.916s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" released by "delete_snapshot" :: held 2.934s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Created reservations ['73d8adfb-e8c2-48a6-8adc-70d7bbc6b999', '9d89dc83-dca8-40a9-af61-d01ec2b6e404', '6038919a-c374-4908-884b-5b98b4138e4d', '86a024d8-d3c2-4e1c-ba8b-3508e7d20e81'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:46:00 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Delete snapshot completed successfully. Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-018d233e-23ad-4c73-a191-fcae4826a50e tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-30ab87ab-6298-4f05-9480-fd02092cb872-delete_snapshot" released by "delete_snapshot" :: held 3.056s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-b03727d7-ebf7-4fb7-b131-2db42f993e20-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-b03727d7-ebf7-4fb7-b131-2db42f993e20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" acquired by "delete_volume" :: waited 0.015s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43c6982-5ceb-4f2a-a696-5ac19def3b05]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:46:00 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:00 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:46:00 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:01 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.752s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:01 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:01 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20 Jul 09 09:46:01 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:02 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-b03727d7-ebf7-4fb7-b131-2db42f993e20" returned: 0 in 0.633s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-b03727d7-ebf7-4fb7-b131-2db42f993e20" released by "delete_volume" :: held 1.441s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Created reservations ['a7dbac6e-5d49-45f6-9019-c42516e399c6', '924bd6a5-4c61-4974-bcad-35462abff76a', '78844a42-d1d9-40dd-9c34-51058933728d', 'c2669de9-61c8-4c82-9c0a-374344ed0346'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:02 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:46:02 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-24e54dfa-9543-4dc0-a868-b81a16c4ced4-delete_volume" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:46:02 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.625s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-24e54dfa-9543-4dc0-a868-b81a16c4ced4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:46:02 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Deleted volume successfully. Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-09c13fea-1f62-4970-8cb8-adcf41785f56 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-b03727d7-ebf7-4fb7-b131-2db42f993e20-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" by "delete_volume" {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" acquired by "delete_volume" :: waited 0.016s {{(pid=87265) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a8549a-2ff8-4335-897e-227196336979]: (4, 'qcow2') {{(pid=88229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:46:02 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:03 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 Jul 09 09:46:03 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:03 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4" returned: 0 in 0.734s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:03 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:03 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4 Jul 09 09:46:03 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:04 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec/volume-24e54dfa-9543-4dc0-a868-b81a16c4ced4" returned: 0 in 0.646s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-quobyte-24e54dfa-9543-4dc0-a868-b81a16c4ced4" released by "delete_volume" :: held 1.417s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG cinder.quota [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Created reservations ['3b0c1ee6-672b-4d62-b2cc-1352e6f859d6', 'a1270127-e2be-418f-9d2d-e81df1b1aa36', 'bc9dc1e1-375b-4173-9668-6218d8bed06c', '181ca8e9-1cf0-4935-99e6-c17b81ae2fe1'] {{(pid=87265) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd': None} {{(pid=87265) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG cinder.volume.drivers.quobyte [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b7c35daf-b72a-40a1-8e6f-4387a5c440cd'] {{(pid=87265) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.lockutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87265) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:46:04 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:46:04 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec Jul 09 09:46:04 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:46:05 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 09 09:46:05 devstack cinder-volume[87265]: DEBUG oslo_concurrency.processutils [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a543cedeb7b18a21f5e3ea0d5078a6ec" returned: 0 in 0.634s {{(pid=87265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:46:05 devstack cinder-volume[87265]: DEBUG cinder.manager [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Notifying Schedulers of capabilities ... {{(pid=87265) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:46:05 devstack cinder-volume[87265]: INFO cinder.volume.manager [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Deleted volume successfully. Jul 09 09:46:05 devstack cinder-volume[87265]: DEBUG cinder.coordination [None req-31131cf4-4f81-4f08-8c5d-e91b0c344da4 tempest-SnapshotDependencyTests-1981065148 None] Lock "cinder-24e54dfa-9543-4dc0-a868-b81a16c4ced4-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87265) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:46:14 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:46:15 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=29,cinder:SELECT=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:46:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:SELECT=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:46:28 devstack cinder-volume[87265]: DEBUG dbcounter [-] [87265] Writing DB stats cinder:UPDATE=1 {{(pid=87265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}